News for hackers. Stuff that matters.

A comment on Groq runs Mixtral 8x7B-32k with 500 T/s. Parent comment

Re:Groq runs Mixtral 8x7B-32k with 500 T/s by Oras on Monday February 19, 2024 @10:38AM (#39430924)
Impressive speed. Are there any plans to run fine-tuned models?
[ Parent | on HN ]
Re:Groq runs Mixtral 8x7B-32k with 500 T/s by tome on Monday February 19, 2024 @11:12AM (#39431364)
Yes, we're working on a feature to give our partners the ability to deploy their own fine-tuned models.
[ Parent | on HN ]