News for hackers. Stuff that matters.

A comment on Mistral 7B, the most powerful language model for its size to date, Apache 2.0. Parent comment

Re:Mistral 7B, the most powerful language model for its size... by LoganDark on Wednesday September 27, 2023 @01:50PM (#37678376)
Windows is not open source. In order to access the source code, you need a government contract. These aren't given out lightly.
[ Parent | on HN ]
Re:Mistral 7B, the most powerful language model for its size... by piperswe on Wednesday September 27, 2023 @01:55PM (#37678462)
Right, that's the point they're making.
[ Parent | on HN ]
Re:Mistral 7B, the most powerful language model for its size... by LoganDark on Wednesday September 27, 2023 @02:06PM (#37678671)
Recent models may not be fully open source, but could you point me to one that's subject to the same amount of scrutiny as Windows source code access? Because I'm not sure if there is one out there.
[ Parent | on HN ]
Re:Mistral 7B, the most powerful language model for its size... by monocasa on Wednesday September 27, 2023 @02:12PM (#37678766)
Windows source access is given out pretty freely to academics as the Windows Research Kernel (WRK).

But the point is that the data pipeline and tensorflow or what have you that trained the model is the source here. The model is the binary.

[ Parent | on HN ]
Re:Mistral 7B, the most powerful language model for its size... by LoganDark on Thursday September 28, 2023 @03:14PM (#37694266)
That's parts of the NT kernel, not actaul Windows source access. Governments get access to the whole thing.

Some large OEMs get access to Windows Server source code as well.

[ Parent | on HN ]
Re:Mistral 7B, the most powerful language model for its size... by monocasa on Thursday September 28, 2023 @07:55PM (#37697577)
https://www.microsoft.com/en-us/sharedsource/

Microsoft has other mechanisms for sharing source and is remarkably open. The symbol servers are relatively public as well. They are at a scale where they rely more on legal strength to keep their IP rather than it not being externally accessible in the first place, at least for Windows.

[ Parent | on HN ]
Re:Mistral 7B, the most powerful language model for its size... by spullara on Wednesday September 27, 2023 @02:47PM (#37679355)
Most partners can get a copy of the Windows source code if they need it.

https://www.microsoft.com/en-us/sharedsource/

[ Parent | on HN ]