News for hackers. Stuff that matters.
Re:Groq surpasses 1,200 tokens/sec with Llama 3 8B by verdverm on Thursday May 30, 2024 @04:13PM (#40528074)
Cerebrus faces similar challenges with their wafer scale chips.

If anything, Google's TPU advancements chart a viable course. I suspect both Groq and Cerebrus will overcome the challenges and offer competitive compute options, depending on the context

Re:Groq surpasses 1,200 tokens/sec with Llama 3 8B by snhbsqub on Saturday June 08, 2024 @01:27AM (#40615472)
SambaNova is the only one if the chip startups that is viable. It surprises me that people don’t see this.