News for hackers. Stuff that matters.

A comment on Groq runs Mixtral 8x7B-32k with 500 T/s. Parent comment

Re:Groq runs Mixtral 8x7B-32k with 500 T/s by kcorbitt on Monday February 19, 2024 @05:30PM (#39435609)
This actually already exists! We did a writeup of the relevant optimizations here: https://openpipe.ai/blog/s-lora
[ Parent | on HN ]

There are no comments on this comment yet.