News for hackers. Stuff that matters.
Re:Nvidia announces its most powerful AI chip as it seeks to... by my123 on Monday March 18, 2024 @05:21PM (#39750184)
The 30x number is for a really narrow scenario tbh. Running a GPT 1.8T parameters (w/ MOE) on one GB200
Re:Nvidia announces its most powerful AI chip as it seeks to... by huac on Monday March 18, 2024 @05:33PM (#39750321)
'narrow scenario,' perhaps, but one that also happens to closely match rumors for GPT4's size