Groq runs Mixtral 8x7B-32k with 500 T/s

Re:Groq runs Mixtral 8x7B-32k with 500 T/s by doubtfuluser on Monday February 19, 2024 @12:44PM (#39432497)

Nice… a startup that has two “C” positions CEO and Chief Legal Officer…

That sounds like a fun place to be

[ Parent | on HN ]

Re:Groq runs Mixtral 8x7B-32k with 500 T/s by kumarm on Monday February 19, 2024 @01:11PM (#39432841)

They seem to be around since 2016. May be not bad for a LLM company that would need to deal with legal issues?

[ Parent | on HN ]

Re:Groq runs Mixtral 8x7B-32k with 500 T/s by matanyal on Monday February 19, 2024 @06:22PM (#39436064)

When you have a pile of hardware and silicon Intellectual Property, patents, etc, IMO it's pretty clever. However, I'm a Groq Engineer, and I'm mega-biased.

[ Parent | on HN ]