Re:OpenAI’s CEO Says the Age of Giant AI Models Is Already Over
by jutrewag on Monday April 17, 2023 @04:49PM
(#35606432)
What about 1T though, seems silly to stop here.
[ Parent
| on HN ]
Re:OpenAI’s CEO Says the Age of Giant AI Models Is Already Over
by brookst on Tuesday April 18, 2023 @12:41PM
(#35616381)
Like Altman said, it's comparable to the GHz race in the 1990's. If 4GHz is good, 5GHz is better, why not 10GHz?
Turns out there are diminishing returns and advances come from other dimensions. I've got no opinion on whether he's right or not, but he's certainly in a better position to opine that current scale has hit diminishing returns.
In any event, there's nothing special about 1T parameters. It's just a round base-10 number. It is no more magic than 900B or 1.3T.