News for hackers. Stuff that matters.

A comment on Groq runs Mixtral 8x7B-32k with 500 T/s.

Re:Groq runs Mixtral 8x7B-32k with 500 T/s by itsmechase on Monday February 19, 2024 @07:15AM (#39428931)
Incredible tool. The Mixtral 8x7B model running on their hardware did 491.40 T/s for me…
[ Parent | on HN ]

There are no comments on this comment yet.