There's a HUGE difference in enjoying/playing sports compared to vicariously living through professional athletes.
Getting together with friends for a pick-up game is not difficult and much more gratifying and you can still drink beer afterwords.
Sports fans have welcomed me, and been very accommodating explaining parts of the game I don't understand.
And then there are other geeks like you - that have an almost visceral reaction to the idea that people would enjoy something like that. I don't understand people who have such a negative view of others' happiness.
Oh I'm sure you have some kind of horror locker-room story where the football team did something disgusting to you, but sports wasn't what did it. Those alpha males would have some something similar even without the context of sports.