Re:Groq runs Mixtral 8x7B-32k with 500 T/s
by matanyal on Monday February 19, 2024 @06:05PM
(#39435896)
Groq Engineer here as well; we actually built our compiler to compile pytorch, TensorFlow, and Onnx natively, so a lot of the amazing work being done by y'all isn't building much of a moat. We got LLama2 working on our hardware in just a couple of days!
[ Parent
| on HN ]
There are no comments on this comment yet.