I find it easier to plan for myself, then invite people. Otherwise I feel like I spend my life waiting for others to make up their mind.

Over time, you have different people for different activities: the athletes, the stoners, the foodies, the geeks, the gamers and so on. It becomes a lot easier to plan.