News for hackers. Stuff that matters.
Re:Grok by solarkraft on Sunday March 17, 2024 @04:20PM (#39737693)
He also called permissively licensing Tesla's patents "open sourcing" them. He's at the forefront of misusing the term.
Re:Grok by drexlspivey on Sunday March 17, 2024 @07:04PM (#39738866)
The “source” in “open source” refers to source code which they released. A dataset is not source code, if anyone is misusing the term it’s you.
Re:Grok by solarkraft on Sunday March 17, 2024 @08:20PM (#39739296)
Re:Grok by frabcus on Sunday March 17, 2024 @07:53PM (#39739123)
I consider the weights a binary program and the source code is the training data. The training algorithm is the compiler.

I agree this isn't standard terminology, but it makes the most sense to me in terms of power dynamics and information flow.

We know from interpretability research that the weights do algorithms eg sin approximation etc. So they feel like binary programs to me.

Re:Grok by HarHarVeryFunny on Sunday March 17, 2024 @09:12PM (#39739613)
If you can't rebuild it, then how can you be considered to have the "source code" ?

The training data isn't a dataset used at runtime - it's basically the source code to the weights.

Not sure it really matters here though (who has the GPUs and desire to retrain Grok?), but just as a matter of definition "open weights" fits better than "open source".