News for hackers. Stuff that matters.

A comment on Mistral 7B, the most powerful language model for its size to date, Apache 2.0. Parent comment

Re:Mistral 7B, the most powerful language model for its size... by syntaxing on Wednesday September 27, 2023 @05:13PM (#37681407)
But they built a llama equivalent + some enhancements that gives better performance…I’m not sure if this would be possible at all without Meta releasing all the required code and paper for LLaMa to begin with.
[ Parent | on HN ]
Re:Mistral 7B, the most powerful language model for its size... by monocasa on Wednesday September 27, 2023 @05:43PM (#37681768)
Meta didn't release all of the required code to build LLaMa, just enough run inference with their weights.
[ Parent | on HN ]