I suspect we’ll plateau at some point and the gigafactories won’t produce a massive advantage. So running your own models could very well be a thing.
Re:My AI skeptic friends are all nuts
by jhatemyjob on Wednesday June 04, 2025 @12:52AM
(#44177335)
Yea probably..... I wonder when the plateau is. Is it right around the corner or 10 years from now? Seems like they can just keep growing it forever, based on what Sam Altman is saying. I'm botching the quote but either he or George Hotz said something to the effect of: every time you add an order of magnitude to the size of the data, there is a noticeable qualitative difference in the output. But maybe past a certain size you get diminishing returns. Or maybe it's like Moore's Law where they thought it would just go on forever but it turned out it's extremely difficult to get the distance between two transistors smaller than 7nm
Re:My AI skeptic friends are all nuts
by mwarkentin on Wednesday June 04, 2025 @07:16AM
(#44179449)
Yes, some think it’s happening now: https://www.aisnakeoil.com/p/is-ai-progress-slowing-down
Of course you could disagree with my prediction and that these big tech companies are going to build MASSIVE gpu farms the size of the Tesla Gigafactory which can run godlike AI where nobody can compete, but if we get to that point I feel like we will have bigger problems than "AI react code is better than AI solidjs code"