Re:Mistral 7B, the most powerful language model for its size...
by artursapek on Wednesday September 27, 2023 @10:59PM
(#37684664)
The JPEG analogy makes no sense. A more correct analogy is: they released compiled binaries, not the source code.
The difference is though, here compiling from source is prohibitively expensive for the average person. And the source is massive.
In essence the output of the training pipeline is "data" (weights), not code. The way those data are read to make things work is the "model". In the (bad) analogy of the JPEG, the data is the coefficients and the model is the encoding/decoding scheme.
I'm impressed by the patience monocasa has in the face of so many (seemingly intentionally) obtuse responses.