News for hackers. Stuff that matters.

A comment on Groq runs Mixtral 8x7B-32k with 500 T/s. Parent comment

Re:Groq runs Mixtral 8x7B-32k with 500 T/s by mirekrusin on Monday February 19, 2024 @04:11PM (#39434882)
Are you considering targeting consumer market? There are a lot of people throwing $2k-$4k into local setups and they primarily care about inference.
[ Parent | on HN ]
Re:Groq runs Mixtral 8x7B-32k with 500 T/s by tome on Monday February 19, 2024 @04:16PM (#39434930)
At the moment we're concentrating on building out our API and serving the enterprise market.
[ Parent | on HN ]