Re:Today's open source models beat closed source models from...
by Zambyte on Sunday April 14, 2024 @08:06PM
(#40035688)
If you have access to any language models, I encourage you to ask this question:
> What is the significance of the word "source" in the expression "source code"?
I landed on this question by first asking it about "open source" rather than "source code", but the answers referred to "source code", which is a bit circular for this conversation. I'll share a truncated version of how Mistral Large replied:
> It is called the "source" because it is the origin or the primary input from which the executable form of the program is derived.
The primary input from which a language model is derived is the training data. That is the source. If the training data for a model is not open, then the model is not open source, because the source of the model is not open.
Disagreeing with you is not the same as not understanding. There clearly isn't a consensus, but no shortage of people just asserting that others are wrong.