News for hackers. Stuff that matters.
Re:Ring-Zero: Scaling Zero RL to a Trillion Parameters for E... by Zababa on Friday July 17, 2026 @03:30AM (#48944341)
Considering progress in the rest of computing stuff (RAM, CPUs, storage) is kind of "linear"/exponential it sure looks like it's an engineering gap and we're on the right track. GPT 3 was 175B parameters and is today crushed by models that are 32B parameters, that's a lot of progress in 6 years.

There are no comments on this comment yet.