Groq runs Mixtral 8x7B-32k with 500 T/s

Re:Groq runs Mixtral 8x7B-32k with 500 T/s by fennecbutt on Monday February 19, 2024 @09:25PM (#39437361)

Are there voice responses in the demo? I couldn't find em?

[ Parent | on HN ]

Re:Groq runs Mixtral 8x7B-32k with 500 T/s by tome on Tuesday February 20, 2024 @03:08AM (#39439020)

Here's a live demo of CNN of Groq plugged into a voice API

[ Parent | on HN ]

Re:Groq runs Mixtral 8x7B-32k with 500 T/s by fennecbutt on Tuesday February 20, 2024 @06:42AM (#39440143)

Thanks, that's pretty impressive. I suppose with blazing fast token generation now things like diarisation and the actual model are holding us back.

Once it flawlessly understands when it is being spoken to/if it should speak based on the topic at hand (like we do) then it'll be amazing.

I wonder if ML models can feel that feeling of wanting to say something so bad but having to wait for someone else to stop talking first ha ha.

[ Parent | on HN ]

Re:Groq runs Mixtral 8x7B-32k with 500 T/s by sinuhe69 on Wednesday February 21, 2024 @12:57AM (#39450618)

Wow! Absolutely astounding!

[ Parent | on HN ]