News for hackers. Stuff that matters.

A comment on Groq Raises $640M to Meet Soaring Demand for Fast AI Inference. Parent comment

Re:Groq Raises $640M to Meet Soaring Demand for Fast AI Infe... by eigenvalue on Monday August 05, 2024 @02:58PM (#41164237)
It takes a while to design, manufacture, and test/validate new silicon. There is also a very elaborate software stack on top of it. This is a multi-year effort to reproduce for an extremely talented, nimble engineering team. And by then, Groq will have even more refined and powerful systems available.

Also, when an end market is growing as fast as the AI compute market is, multiple players can do very well for years at a time. I think Groq also has a high probability of being acquired by Google/Microsoft/Apple/Meta if the FTC allows it. But they are probably better off following the hockey stick growth for a couple more years before doing that.

[ Parent | on HN ]
Re:Groq Raises $640M to Meet Soaring Demand for Fast AI Infe... by aurareturn on Tuesday August 06, 2024 @12:34AM (#41167781)
Nvidia should have a far more well oiled machine in designing/validating new silicon. Software stack? Nvidia already has that. All models are optimized for CUDA - not Grog.

At a very high level, Nvidia just needs to break out the Tensor cores into its own chips, add loads of SRAM, and run CUDA. They already have all the other datacenter stuff figured out such as interconnects.

[ Parent | on HN ]