Re:Introducing DBRX: A New State-of-the-Art Open LLM by Data...
by jsight on Wednesday March 27, 2024 @10:47AM
(#39839925)
ollama run mixtral will default to the quantized version (4bit IIRC). I'd guess this is why it can fit with two 3090s.
[ Parent
| on HN ]
There are no comments on this comment yet.