If your goals, personalities or experience don't align, it will suck to play games with certain people. But that's the case for all social activities. But plenty of game groups exists with enough people that you don't have to play with the people you don't like playing with.