I was fortunate to have an ROTC scholarship (open to most Americans who qualify) which paid for tuition, but I paid it back in spades with the 10 years I subsequently gave in service. Perhaps that's unwarranted privilege - only you can interpret that.
No, I'm happy for you and glad you had the opportunity. It's just you started your anecdote about humble beginnings, and yet you had a full ride in college. You might not see yourself as a rich kid, but leaving college without crushing debt is something only a privileged few can do these days.
https://secure.marketwatch.com/story/class-of-2015-has-the-m...
It sounds like, similar to many popular people I've known, you have impostor syndrome. Despite all evidence to the contrary, you swear up and down that you're a square peg and an outsider. And you really believe it. You're not doing it for sympathy. I can clearly detect that from you.
Yet, I don't imagine you would want to trade places with any of the guys you blackballed from your friendly club. Having been a navy fighter pilot, are you really going to try to tell me, with a straight face, about how hard it was to pay for school or fit in?