“My boyfriend & I agree a lot about the past and future because we’re afraid of losing eac asdfadsf ”

My boyfriend & I agree a lot about the past and future because we're afraid of losing each other. Is there a better/good way to handle our emotions? His ex-girlfriend is in the same city that I'm moving to, and I'm afraid that when he visits me next time, he'll be reminded of the things he did with her and places they visited together. After all, they've been together for longer than I have been with himn(Thanks.)