That idea of being a comfortable tenured professor at a great school is a dream for many. And obviously, many don't make it, lot of folks are going to just drift around as adjunct professors, scraping by, taking second jobs. But as long as SOMEONE is getting to be a full professor at Stanford, lots of people are going to think, "that could be me", and get exploited along the way.
Arguably even the winners in academia don't make that much in terms of money but they're still viewed as successful professionals, have a decent lifestyle, and do OK--especially if they're not in the highest cost areas.
That guilt is proportional to the value you place on your work-time/daily output. The guilt will subside as your output importance does.
Also, the grass often appears greener, and many in academia are mired in its doldrums too.
Sounds like you're under 45
Every now and then I get an overwhelming sense of guilt when I talk to/think about my friends who are engaged in academia or pursuing advanced degrees (I'm 28, for reference).
The crazy workloads they have, the insane restrictions on how they can do their jobs, and the cut-throat nature of the industry means that they're working so much harder than I am, and are either doing their part to advance the grand sum of human knowledge, or are training to literally save peoples lives...and I'm sitting here, a college drop out, getting paid _way_ more than they're making, in an industry where I will never have any fears about job security, playing with networking equipment and writing about it.