If you move, are you upset your neighbors don't travel with you? I sincerely don't understand the point you were making. Obviously having a network of family and friends matters too, but your children will grow up and leave. Your friends might leave too. Do you think those relations were a waste of time as well.

Most things are ephemeral in a human lifetime. That's why it's better to appreciate what you have now, in the moment; than lamenting something in the past.