Re:Nvidia hits $3T market cap on back of AI boom
by int_19h on Wednesday June 05, 2024 @10:55PM
(#40592945)
Not at all. There's definitely a lot of hype about how "our 7B model is almost as good as GPT-4" etc, but upon close inspection, it turns out to be cherry picked meaningless numbers every single time.
At the same time, there's no evidence that even at the scale of GPT-4 they are seeing diminishing returns. I don't see why that would be the case, either, so long as there's more data to feed into the models. IMO the cliff will occur once the models become large enough that no amount of naturally sourced data is enough to saturate them, but, well, we aren't even at 1% of the Internet yet.
At the same time, there's no evidence that even at the scale of GPT-4 they are seeing diminishing returns. I don't see why that would be the case, either, so long as there's more data to feed into the models. IMO the cliff will occur once the models become large enough that no amount of naturally sourced data is enough to saturate them, but, well, we aren't even at 1% of the Internet yet.