You're not describing the real problem there. It's perfectly fine for a company to throw a hundred servers at something to save dev time.

The problem is programs that are running on thousands or millions of machines but don't get optimized, because the customer runs the program and pays the costs and it's hard for them to blame any program in particular.