News for hackers. Stuff that matters.

supercharger9

Re:Groq runs Mixtral 8x7B-32k with 500 T/s on Monday February 19, 2024 @03:29PM (#39434410)
Then reference that in the homepage? If not for this HN thread, I wouldn't have know you sell hardware.
Re:Groq runs Mixtral 8x7B-32k with 500 T/s on Monday February 19, 2024 @03:19PM (#39434307)
Ignoring latency but not throughput, How does this compare in terms of Cost ( cards Acquisition cost and Power needed) with Nvidia GPU for inference?
Re:Groq runs Mixtral 8x7B-32k with 500 T/s on Monday February 19, 2024 @12:51PM (#39432600)
Do they make money from LLM service or by selling hardware? Homepage is confusing without any reference to other products.