Re:Kimi K2 Thinking, a SOTA open-source trillion-parameter r...
by lossolo on Friday November 07, 2025 @09:11AM
(#45846580)
Small models handle simple, low context tasks most of the time correctly. But for more complex tasks, they fail due to insufficient training capacity and too few parameters to integrate the necessary relationships.
There is obviously also some amount (maybe a lot) of core knowledge and capability needed even to be able to ask the right questions and utilize the answers.