What they are really saying is "It was fun (going to the bar/playing video games/whatever) with you when we were young, but I'm not young anymore and have a family to spend time with, I wish you had one too so I could invite you to family oriented activities." but knowing that you won't understand they say they are too busy and tired.