I'm also pretty aure you'll see it eventually... Consider the possibility that this is both a bubble waiting to pop, as well as the stuff that will shape the future. Kind of like the Internet around the year 2000.

Depends on the technology. It’s hard to look at the progress from December of 2022 till today, and think we won’t go further. Image generation is getting better every day. Parts of the video generation pipelines are also advancing.

the counterpoint is since then we've killed all the easy ways to scale. the datasets can't get bigger because it's already the whole Internet. model sizes can't grow that much because you start running into RAM constraints. efficiency definitely can be improved, but probably not more than 100x on our current architectures.