News for hackers. Stuff that matters.
Re:Groq runs Mixtral 8x7B-32k with 500 T/s by xzyaoi on Tuesday February 20, 2024 @08:07AM (#39440736)
There's also papers for hosting full-parameter fine-tuned models: https://arxiv.org/abs/2312.05215

Disclaimer: I'm one of the authors.

There are no comments on this comment yet.