News for hackers. Stuff that matters.
Re:The Claude Delusion by cronin101 on Saturday November 14, 2026 @09:46AM (#50497439)
I think this is written forgetting a lot of the context of the time (I was at a relevant part of the industry to be present around some of the early “oh shit this thing works” moments).

It was absolutely not a given that next-token prediction would scale to the point that it could answer outside of its training domain (this is the point about “made up questions”, it was important to test it on material outside of the training set since the scale of training was yet-unheard-of at the time).

Further, the success of post-training on verifiable tasks (coding) was also a complete shock that changed the world overnight. LLMs jumped the “I can make code” to “I confidently can make code that solves your problem” chasm suddenly, and it has changed the industry.

For someone so invested in this from the early days (remember the scale of Microsoft’s commitment) it is entirely logical that testing things “on day one” would occur and this would be a much bigger shock compared to most people that learned of advances at the same time as the rest of the world. (There are huge delays between research capabilities and shipping)

There are no comments on this comment yet.