Groq runs Mixtral 8x7B-32k with 500 T/s

Re:Groq runs Mixtral 8x7B-32k with 500 T/s by ionwake on Monday February 19, 2024 @05:58PM (#39435841)

Holy smokes this is fast

[ Parent | on HN ]

Re:Groq runs Mixtral 8x7B-32k with 500 T/s by matanyal on Monday February 19, 2024 @06:06PM (#39435909)

Thanks!

[ Parent | on HN ]