News for hackers. Stuff that matters.
Re:Introducing DBRX: A New State-of-the-Art Open LLM by Data... by speedylight on Friday March 29, 2024 @09:59AM (#39864193)
Quantized models will run well, otherwise inference might be really really slow or the client crashes all together with some CUDA out of memory error.

There are no comments on this comment yet.