News for hackers. Stuff that matters.
Re:Llama 3.1 405B now runs at 969 tokens/s on Cerebras Infer... by adhambadr on Tuesday November 19, 2024 @04:34AM (#42181543)
is it just me or isn't the most important contender in speed, Groq, missing from the comparison ? not sure why does it matter to put azure there, no one uses it for speed.

There are no comments on this comment yet.