People in the industry started saying "oh shit this might be big" at a point between GPT-1 and GPT-2, but there were plenty of naysayers too. It only hit the mainstream with ChatGPT.

Which was also when the capabilities of LLMs became completely impossible to either ignore or excuse as "just matching seen data". But that was, in practice, solvable simply by increasing the copium intake.