News for hackers. Stuff that matters.
Re:Kimi K3, and what we can still learn from the pelican ben... by dopa42365 on Friday July 17, 2026 @02:34PM (#48950722)
It's not like same parameter count models are identical, so that doesn't appear to be an indicator for quality, or even compute requirements?

There seems to be more to producing a better model than brute forcing parameter count after all.

Re:Kimi K3, and what we can still learn from the pelican ben... by tibbar on Friday July 17, 2026 @03:48PM (#48951546)
Training and serving large models does require increasingly more compute, though. (The Chinese labs have clearly found some massive optimizations, but my point was that you'd think at some point even those optimizations wouldn't be enough to keep up with exponentially increasing model sizes.)