News for hackers. Stuff that matters.
Re:Mistral 7B, the most powerful language model for its size... by scosman on Wednesday September 27, 2023 @03:15PM (#37679772)
You could fine tune and release that. It’s not software so exact parallels don’t make sense, but the open permissions are great.
Re:Mistral 7B, the most powerful language model for its size... by monocasa on Wednesday September 27, 2023 @03:37PM (#37680096)
I mean, it's absolutely software.
Re:Mistral 7B, the most powerful language model for its size... by scosman on Wednesday September 27, 2023 @06:05PM (#37682028)
Software is used to make models, but the models aren’t software anymore than Toy Story is software.
Re:Mistral 7B, the most powerful language model for its size... by mbakke on Wednesday September 27, 2023 @06:34PM (#37682358)
Forgive my ignorance, I haven't studied the AI tooling landscape yet. Are you saying these models have a structured binary format and "running" them is just a matter of having a "player" with the right "codec"?

Or are they directly executing CPU instructions?

Re:Mistral 7B, the most powerful language model for its size... by monocasa on Wednesday September 27, 2023 @07:06PM (#37682710)
They are basically a series of intermediate bytecodes to be compiled to the hardware they actually run on, in addition to the large tables of weights that bytecode references.
Re:Mistral 7B, the most powerful language model for its size... by scosman on Wednesday September 27, 2023 @11:27PM (#37684842)
Just a few billion of them that no person created or understands, which are based on the their input data and not design decisions, which include random initialization. I see no reason to treat them any differently than software in a conversation about OSS.
Re:Mistral 7B, the most powerful language model for its size... by kanwisher on Thursday September 28, 2023 @09:43AM (#37689501)
Model inputs are definitely design decisions, what data to use, how to fine tune them, what methods were used in weighting things. This is LITERALLY the source of the model. The model is a binary like an EXE
Re:Mistral 7B, the most powerful language model for its size... by monocasa on Wednesday September 27, 2023 @06:15PM (#37682147)
There's literally a list of opcodes to be executed in the model. There's a whole lot of data too, but that's part of the build just as much as anything in a .data section.
Re:Mistral 7B, the most powerful language model for its size... by camgunz on Thursday September 28, 2023 @01:58PM (#37693234)
Toy Story is also software. It's a program you run on a renderer to generate a/v.