News for hackers. Stuff that matters.
Re:Today's open source models beat closed source models from... by andy99 on Sunday April 14, 2024 @10:48AM (#40031464)
> people don't seem to understand why the word "source" is in there.

Disagreeing with you is not the same as not understanding. There clearly isn't a consensus, but no shortage of people just asserting that others are wrong.

Re:Today's open source models beat closed source models from... by Zambyte on Sunday April 14, 2024 @08:06PM (#40035688)
If you have access to any language models, I encourage you to ask this question:

> What is the significance of the word "source" in the expression "source code"?

I landed on this question by first asking it about "open source" rather than "source code", but the answers referred to "source code", which is a bit circular for this conversation. I'll share a truncated version of how Mistral Large replied:

> It is called the "source" because it is the origin or the primary input from which the executable form of the program is derived.

The primary input from which a language model is derived is the training data. That is the source. If the training data for a model is not open, then the model is not open source, because the source of the model is not open.