Re:Maintaining large-scale AI capacity at Meta
by furyofantares on Sunday June 16, 2024 @10:12PM
(#40701747)
That trillion+ parameter count is the sum of each of the "experts", right?
[ Parent
| on HN ]
Re:Maintaining large-scale AI capacity at Meta
by oersted on Monday June 17, 2024 @03:23AM
(#40703059)
The ever-circulating rumour is 1.7T - 1.8T for the whole thing. But it is not very substantiated, mostly started by SemiAnalysis and geohot based on rather loose speculation (such as API latency and price), and not much solid evidence to confirm it after that.
And of course, it must have changed substantially with GPT-4-Turbo and GPT-4o. It would make sense if the cost reduction was larger than the price reduction, they probably have a higher profit margin now, and the price reduction has been very significant since GPT-4 release.