News for hackers. Stuff that matters.

A comment on Groq runs Mixtral 8x7B-32k with 500 T/s. Parent comment

Re:Groq runs Mixtral 8x7B-32k with 500 T/s by karthityrion on Monday February 19, 2024 @01:42PM (#39433163)
So, is this specific chip only for LLMs as the name LPU suggests Language Processing Unit, right?
[ Parent | on HN ]
Re:Groq runs Mixtral 8x7B-32k with 500 T/s by tome on Monday February 19, 2024 @02:37PM (#39433758)
The chip is capable of running general numerical compute, but because we're focusing almost entirely on LLMs at the moment we've branded it the LPU.
[ Parent | on HN ]