Re:Kimi K2 Thinking, a SOTA open-source trillion-parameter r...
by a-dub on Thursday November 06, 2025 @07:05PM
(#45842138)
i disagree. words matter. the whole point of open source is that anyone can look and see exactly how the sausage is made. that is the point. that is why the word "open" is used.
...and sure, compiling gcc is nondeterministic too, but i can still inspect the complete source from where it comes because it is open source, which means that all of the source materials are available for inspection.
Re:Kimi K2 Thinking, a SOTA open-source trillion-parameter r...
by danielmarkbruce on Thursday November 06, 2025 @08:20PM
(#45842608)
The point of open source in software is as you say. It's just not the same thing though. Using words and phrases differently in different fields is common.
Re:Kimi K2 Thinking, a SOTA open-source trillion-parameter r...
by a-dub on Friday November 07, 2025 @12:02AM
(#45843676)
...and my point is that it should be.
the practice of science itself would be far stronger if it took more pages from open source software culture.
Re:Kimi K2 Thinking, a SOTA open-source trillion-parameter r...
by h33t-l4x0r on Friday November 07, 2025 @02:21AM
(#45844240)
I agree that they should say "open weight" instead of "open source" when that's what they mean, but it might take some time for people to understand that it's not the same thing exactly and we should allow some slack for that.
Re:Kimi K2 Thinking, a SOTA open-source trillion-parameter r...
by a-dub on Friday November 07, 2025 @09:53AM
(#45847018)
no. truly open source models are wonderful and remarkable things that truly move the needle in education, understanding, distributed collaboration and the advancement of the state of the art. redefinition of the terminology reduces incentive to strive for the wonderful goal that they represent.
Re:Kimi K2 Thinking, a SOTA open-source trillion-parameter r...
by HarHarVeryFunny on Friday November 07, 2025 @11:05AM
(#45847805)
There is a big difference between open source for something like the linux kernel or gcc where anyone with a home PC can build it, and any non-trivial LLM where it takes cloud compute and costs a lot to train it. No hobbyist or educational institution is going to be paying for million dollar training runs, probably not even thousand dollar ones.
Re:Kimi K2 Thinking, a SOTA open-source trillion-parameter r...
by a-dub on Friday November 07, 2025 @12:09PM
(#45848528)
"too big to share." nope. sharing the finished soup base, even if well suited for inclusion in other recipes, is still different from sharing the complete recipe. sharing the complete recipe encourages innovation in soup bases, including bringing the cost down for making them from scratch.
Re:Kimi K2 Thinking, a SOTA open-source trillion-parameter r...
by danielmarkbruce on Friday November 07, 2025 @01:08PM
(#45849136)
There is an enormous amount of information in the public domain about building models. In fact, once you get into the weeds you'll realize there is too much and in many cases (not all, but many) the very specific way something was done or what framework they used or what hardware configuration they had was just a function of what they have or have experience with etc. One could spend a lifetime just trying to repro olmo's work or a lot of the huggingface stuff....
On top of that, in many cases a company/group/whoever can't even reproduce the model themselves. There are lots of sources of non-determinism even if folks are doing things in a very buttoned up manner. And, when you are training on trillions of tokens, you are likely training on some awful sounding stuff - "Facebook is trained llama 4 on nazi propaganda!" is not what they want to see published.
How about just being thankful?