News for hackers. Stuff that matters.
Re:An OpenAI model has disproved a central conjecture in dis... by danielmarkbruce on Wednesday May 20, 2026 @11:25PM (#48217507)
yes, it does. That's why OpenAI refers to it's small models as small. They are just so different. The capabilities have changed dramatically. The use cases are wildly different. The architectures are quite different. Even the core idea of attention is different. Training them is materially different. Serving them is materially different. A 1.5 bill parameter model from 2019 is so different from today's LLMs that they really don't have much in common. What we have now is quite similar to what we had a couple years ago though.

There are no comments on this comment yet.