Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Groq surpasses 1,200 tokens/sec with Llama 3 8B. Parent comment
Groq - mainly hardware, the LPU (https://wow.groq.com/lpu-inference-engine/)
Grok - Elon's de jour AI endeavor
There are no comments on this comment yet.
Groq - mainly hardware, the LPU (https://wow.groq.com/lpu-inference-engine/)
Grok - Elon's de jour AI endeavor