Most geeks feel that way? I think you're generalizing your own feelings onto a group that you self-identify, assuming that if you have this in common, you probably have that in common.

If you've ever gotten satisfaction out of improving your skills in a videogame, or from a team-based multiplayer game, then you have the "enjoys self-improvement and team based competition" part of the brain. It's just the physical aspect you don't enjoy.