News for hackers. Stuff that matters.
Re:Llama 3.1 405B now runs at 969 tokens/s on Cerebras Infer... by frogfish on Tuesday November 19, 2024 @03:50AM (#42181280)
Genuinely curious and willing to learn: what are the different inference approaches broadly? Is there any difference in the approach between Cerebras and simplismart.ai which claims to be the fastest?

There are no comments on this comment yet.