News for hackers. Stuff that matters.

A comment on Llama 3.1 405B now runs at 969 tokens/s on Cerebras Inference. Parent comment

Re:Llama 3.1 405B now runs at 969 tokens/s on Cerebras Infer... by aurareturn on Tuesday November 19, 2024 @02:13AM (#42180762) 

  I'm not talking about that. I and many others here have spun up 8x or more H100 clusters and run this exact model. Zero other traffic. You won't come anywhere close to this.
8x H100 can also do fine tuning right? Does Cerebras offer fine tuning support?
[ Parent | on HN ]

There are no comments on this comment yet.