Some workplaces have sporting clubs that people participate in to grow closer to their coworkers. Yet if you don't like tenis, baseball, basketball, golf, or hiking then you are out of luck.

Every social activity will exclude people who don't like the activity by default. There's no real working around this.

Even if you just have a 'talking' club, you exclude people who aren't natural extroverts or find large group conversations to be maddening.

In essence, there's no way to be perfectly fair... so at best you can have different choices to try to be as inclusive as possible with limited time.