Re:Introducing DBRX: A New State-of-the-Art Open LLM by Data...
by speedylight on Friday March 29, 2024 @09:59AM
(#39864193)
Quantized models will run well, otherwise inference might be really really slow or the client crashes all together with some CUDA out of memory error.
[ Parent
| on HN ]
There are no comments on this comment yet.