Many people say that and I am always puzzled why. Over the past 10 years, no one has ever looked at me funny or laughed at me - and I was in my early 40s when I started. Supportive crowd, eager to help if asked (spotting, etc).
It's not an unfounded feeling either, when I first started going, I got ejected or talked to for rules I didn't know about yet: no jeans, no open toed shoes, don't touch those machines, you don't do that with dumbbells. And that's just the formal rules, then there's the informal: how long can I occupy a machine? Can I take the dumbbells into the other room? what's "switching in"? how much is talking allowed? Can this injure me? Is that guy really advanced, or should I tell him that he's going to hurt himself?
I got started in the collage's free gym, with lots of other beginners and rule breakers. But I'd never have shelled out $150 in initiation and membership fees to try out this weird new sport I wasn't comfortable with and might not like.
Probably some level of social anxiety, and fear of being judged/mocked. The reality that none of that won't happen doesn't make itself obvious until you go once, and you don't go because you're anxious, etc., etc.
Probably best to start with pushups / situps at home, cardio at your local park at a deserted hour. Then once you get that confidence start at a cardio-focused gym like 24 hour fitness. Once you get the hang of gym'ing go to one that is more focused on your style, weight-lifting, cross-fit, etc.