News for hackers. Stuff that matters.
Re:Introducing DBRX: A New State-of-the-Art Open LLM by Data... by jsight on Wednesday March 27, 2024 @10:47AM (#39839925)
ollama run mixtral will default to the quantized version (4bit IIRC). I'd guess this is why it can fit with two 3090s.

There are no comments on this comment yet.