As far as current LLM capabilities, I do think there's a massive amount of untapped demand even for that. ChatGPT is like the AOL of genAI — the first majorly successful consumer mass market product, but still ultimately just a proof of concept to capture the popular imagination. The real value will be seen as agents start getting plugged into everything, new generations of startups and small businesses are built from the ground up on LLM-driven business processes by non-technical founders with tiny teams, and any random teenager has a team of AI assistants actively managing their social life and interacting with a variety of platforms on their behalf.
Tons of things that big businesses and public figures pay full-time salaries for humans to do will suddenly become accessible to small uncapitalized ventures and everyday people. None of that requires a fundamental improvement to LLMs as we know them today, just cost reduction through increased supply and continued work by the tech industry to integrate and package these capabilities in user-friendly forms. If ChatGPT is AOL, then 5G, mobile, IOT, smart devices, e-commerce, streaming, social media, and so on should all be right around the corner.
I guess you’re assuming AGI is close and you mean demand for AGI? Because I think there will be significant demand but certainly not endless for things like ChatGPT in its current form. OpenAI’s revenue last year was $4B, which is very impressive but doesn’t feel like the demand is “endless”. By comparison, Apple’s revenue the same year was $400B. There are limits to what LLMs in their current form can do.