Ok, I'll try again because I read the article and watched the demo video from Mosaic:

- MosaicML claims to have some magic that efficiently autoscales with awareness of specific instance per hour pricing.

- MosaicML claims to have auto-optimize magic that makes training 3-7x faster.

- The incentives seem to be aligned because their value prop is likely "we'll markup 10% but save you 50%" (or whatever).

It's too bad Replit didn't provide the costs for this post in the same way Stanford, etc have done with Alpaca, Vicuna, etc. They probably didn't for from-scratch training because the answer to your question is almost certainly "it depends" or "if you have to ask you can't afford it" (for now).