Re:Llama 3.1 405B now runs at 969 tokens/s on Cerebras Infer...
by adhambadr on Tuesday November 19, 2024 @04:34AM
(#42181543)
is it just me or isn't the most important contender in speed, Groq, missing from the comparison ?
not sure why does it matter to put azure there, no one uses it for speed.
[ Parent
| on HN ]
There are no comments on this comment yet.