News for hackers. Stuff that matters.
Re:Mistral: Mixtral of Experts by yodsanklai on Monday December 11, 2023 @08:20AM (#38600396)
Also, considering mistral is open source, what will prevent their competitor to integrate any innovation they make?

Another thing I don't understand, how a 20 people company can provide a similar system as OpenAI (1000 employees)? what do they do themselves, and what do they re-use?

Re:Mistral: Mixtral of Experts by war321 on Monday December 11, 2023 @09:52AM (#38601131)
Companies move slow, especially as they get bigger. Just because a google engineer wants to yoink some open source inferencing innovation for example, doesn't mean they can just jam it into Gemini and have it rolled out immediately.
Re:Mistral: Mixtral of Experts by lossolo on Monday December 11, 2023 @08:38AM (#38600514)
> Also, considering mistral is open source, what will prevent their competitor to integrate any innovation they make?

Their small and tiny models are open source, it seems like a marketing strategy, and bigger models will not be open source. Their medium model is not open source.

> Another thing I don't understand, how a 20 people company can provide a similar system as OpenAI (1000 employees)? what do they do themselves, and what do they re-use?

They do not provide the scale of OpenAI or a model comparable to GPT-4 (yet).