There's also a related problem: once everyone is already paying the cost to purchase and operate backup power on a regular basis, they're not going to bother paying their power bills. They're just going to disconnect from the grid, because people aren't paying them for "power when its most profitable". They're paying for "power when they need it". Grid stability is the literal job of your power company, arguably moreso than power generation.
Which returns back to investments. If consumers will reward companies based on the cost of kw/h, and they will assume that governments take care of balancing the grid, then companies that invest in technology that produce the cheapest kw/h and ignore grid stability. The only way out would be for governments to subsidize less economical ventures but which consider grid stability.
Grid stability cost money and power companies do not want to carry that cost. It is a much better investment for them to let society carry those costs and simply produce as much energy when its most cost effective to do so.