Re:Groq surpasses 1,200 tokens/sec with Llama 3 8B
by spiderfarmer on Thursday May 30, 2024 @03:26PM
(#40527683)
I think groq has more users and a better business model.
[ Parent
| on HN ]
Re:Groq surpasses 1,200 tokens/sec with Llama 3 8B
by snhbsqub on Saturday June 08, 2024 @01:24AM
(#40615465)
Groq makes zero revenue, needs hundreds on chips to run 1 model, and runs everything at lower precision. SambaNova has a lot of revenue, and runs at that speed at full precision on a single node. It really isn’t a competition.