News for hackers. Stuff that matters.
Re:Mistral Large by HPsquared on Monday February 26, 2024 @09:51AM (#39511868)
Especially as the model weights are literally a huge opaque binary blob. Much more opaque than even assembly code. There is plenty of precedent for what "open source" means, and these aren't it.

Edit: not that I mind all that much what they're actually doing, it's just the misuse of the word that bristles.

Re:Mistral Large by zozbot234 on Monday February 26, 2024 @10:13AM (#39512149)
Open source means "the preferred version for modification" and this fits with model weights since you can fine tune them with your own data. Modifying raw training data would be quite unwieldly and pointless.
Re:Mistral Large by HPsquared on Monday February 26, 2024 @10:59AM (#39512769)
It's possible to modify binary executables; doesn't make them open-source.
Re:Mistral Large by wruza on Monday February 26, 2024 @11:11AM (#39512953)
Isn't this comparison completely backwards? As I understand it, it's useless for a person to own a source dataset for an LLM, because its "compilation" costs $n million.