News for hackers. Stuff that matters.
Re:Nvidia announces its most powerful AI chip as it seeks to... by wtallis on Monday March 18, 2024 @07:38PM (#39751379)
The lock-in is more of a bonus for them. The underlying problem is that it's impossible to build a chip big enough, or even a collection of chiplets big enough. Training LLMs requires more silicon than can fit on one PCB, so they need an interconnect that is as fast as possible. With interconnect bandwidth as a critical bottleneck, they're not going to wait around for the industry to standardize on a suitable interconnect when they can build what they need to be ready to ship alongside the chips they need to connect.
Re:Nvidia announces its most powerful AI chip as it seeks to... by l33tman on Tuesday March 19, 2024 @05:34AM (#39754109)
Cerebras: -Hold my beer