Re:The End of AI Frontiers
by ACCount39 on Sunday November 08, 2026 @07:05AM
(#50412542)
No, parameter scaling still works because it broadly increases sample efficiency. We don't have the data to make a Chinchilla optimal 100T, but that doesn't mean there are no gains in building up to 100T.
Thinking tokens have nothing to do with parameter count and where some of the biggest gains have come from.
We're really past the point of scaling parameters being viable. We simply lack the content to make "bigger" better at this point.