News for hackers. Stuff that matters.
Re:Nvidia dethrones Apple as the most valuable company by alecco on Saturday October 26, 2024 @08:11AM (#41954268)
The AMD MI300 is nowhere near Hopper.

A real threat is Cerberas. Their approach avoids the memory bottleneck of loading the whole model DRAM->SRAM for each token batch. I hope their IPO goes well before the AI bubble pops.

Re:Nvidia dethrones Apple as the most valuable company by jiggawatts on Saturday October 26, 2024 @08:04PM (#41958741)
I can see variants of the Cerebras approach taking slices of the VC investment pie.

For example, arrays of identical and simple chips with in-chip memory could have similar performance as the monolithic Cerebras wafers-scale chips. Not for all workloads, but some, such as inference.