> the closer to metal you are, the harder the problems are (mostly due to constraints) but the worse the job is -- pay, culture... it's all bad. Why?

Not saying it’s universal, but I’ve seen this being related to lacking economics of scale. You write software for a limited fleet of widgets and have to constrain your expenses.