News for hackers. Stuff that matters.
Re:Groq CEO: 'We No Longer Sell Hardware' by halflings on Tuesday April 09, 2024 @05:09PM (#39984278)
The # of chips is not the most important metric.

Most important, even ignoring latency, is throughput (tokens) per $$$. And according to their own benchmark [1] (famous last words :)), they're quite cost efficient.

[1] https://www.semianalysis.com/p/groq-inference-tokenomics-spe...

There are no comments on this comment yet.