Re:Introducing DBRX: A New State-of-the-Art Open LLM by Data...
by bevekspldnw on Wednesday March 27, 2024 @06:23PM
(#39845326)
VRAM in excess of the model one is using isn’t useful per se. My use cases require high throughput, and on many tasks the A6000 executes inference at 2x speed.
[ Parent
| on HN ]
There are no comments on this comment yet.