LLM technology will not go away. The premise here is that the foundation model companies will bust. So now there will be tons of idle GPU, where companies like AWS and Azure, or even Coreweave and Lambda, can pick them up for cheap and rent them out to people who want to run open source/open weight models.

LLMs as of whatever open models are SOTA when the proprietary bubble bursts, plus... whatever else you can do on GPUs - weather modeling, CFD, genetics research, and so on, and so on.

And that's at day 0. Because LLMs are not going away, thank to open weight models, and the race for capabilities has left so, so many low-hanging fruits unpicked, we'd have a decade or more of useful R&D to do even if LLM capabilities suddenly plateaued tomorrow and never improved.

I mean, look at Jev making round in the industry now - this is just a single example of a low-hanging fruit that took many years for someone to bother to pick up and market a bit. There's many, many more of these just laying around.