I have no idea if this is dumping or not. At Microsoft/Google scale, what does it cost to serve a million LLM tokens?

Tough to disentangle the capex vs opex costs for them. If they did not have so many other revenue streams, potentially dicey as there are probably still many untapped performance optimizations.