Re:Llama 3.1 405B now runs at 969 tokens/s on Cerebras Infer...
by frogfish on Tuesday November 19, 2024 @03:50AM
(#42181280)
Genuinely curious and willing to learn: what are the different inference approaches broadly? Is there any difference in the approach between Cerebras and simplismart.ai which claims to be the fastest?
[ Parent
| on HN ]
There are no comments on this comment yet.