Re:Kimi K2 Thinking, a SOTA open-source trillion-parameter r...
by Der_Einzige on Friday November 07, 2025 @01:06AM
(#45843917)
That number is as real as the 5.5 million to train DeepSeek. Maybe it's real if you're only counting the literal final training run, but total costs including the huge number of failed runs all other costs accounted for, it's several hundred million to train a model that's usually still worse than Claude, Gemini, or ChatGPT. It took 1B+ (500 billion on energy and chips ALONE) for Grok to get into the "big 4".
[ Parent
| on HN ]
Re:Kimi K2 Thinking, a SOTA open-source trillion-parameter r...
by tw1984 on Friday November 07, 2025 @10:58AM
(#45847718)
Using such theory, one can even argue that the real cost needs to include the infrastructures, like total investment into the semiconductor industry, the national electricity grid, education and even defence etc.
Re:Kimi K2 Thinking, a SOTA open-source trillion-parameter r...
by Der_Einzige on Friday November 07, 2025 @11:00AM
(#45847741)
Correct! You do have to account for all of these things! Unironically correct! :)
Re:Kimi K2 Thinking, a SOTA open-source trillion-parameter r...
by creato on Saturday November 08, 2025 @11:32PM
(#45862915)
That's baked in to the cost of the hardware though.
Re:Kimi K2 Thinking, a SOTA open-source trillion-parameter r...
by michaellee8 on Tuesday November 18, 2025 @01:47PM
(#45970305)
the china government has been heavily subsidizing the electricity