News for hackers. Stuff that matters.

A comment on Mistral 7B, the most powerful language model for its size to date, Apache 2.0. Parent comment

Re:Mistral 7B, the most powerful language model for its size... by monocasa on Thursday September 28, 2023 @08:40PM (#37697907)
That doesn't conflict with anything I've said. Yes, the checkpoint is a

It's not what Mistral's engineers edit to create this release. Just like an ELF file is necessarily contains the code flow graph, in a way extractable by experts, but isn't open source because... it's not source.

[ Parent | on HN ]
Re:Mistral 7B, the most powerful language model for its size... by zamalek on Friday September 29, 2023 @12:15PM (#37706358)
In that analogy the source of the ELF would be hand-written assembly. There aren't many layers of abstraction above the graph when it comes to ML.
[ Parent | on HN ]