News for hackers. Stuff that matters.
Re:Ilya Sutskever to leave OpenAI by epolanski on Tuesday May 14, 2024 @08:01PM (#40361535)
Comments like this make me wonder whether I'm on reddit or HN.

The future trajectory of AI isn't tied to Nvidia's stock in the same way the web didn't thrive or die on Cisco being the most valuable company in the world 24 years ago.

Re:Ilya Sutskever to leave OpenAI by sangnoir on Tuesday May 14, 2024 @08:13PM (#40361624)
Perhaps not in general, but if the barrier of entry is radically lowered - such as if a new technique that drastically lowers the compute required for training is discovered - then Nvidia and a whole host of startups will lose lot of value. A lot of the positions assumes LLMs will remain SotA in the foreseeable future, which is not a bet I'd take.

Even if that doesn't happen, there will be a lot of consolidation and bankruptcies when AI funding dries up when category winners become clear and investors cur their losses - the same happened suddenly when the dot-com bubble burst, and little more gently with "web 2.0" startups

Re:Ilya Sutskever to leave OpenAI by pixl97 on Tuesday May 14, 2024 @08:24PM (#40361686)
If the barrier to entry is lowered I don't see Nvidia losing a dime... Jevons paradox tells us that further massive amounts of training will occur in multi-modality and grounding models to reality. That would then kick off the race to true reasoning and AGI/ASI, and if achieved, all bets are off after that point.

If no training breakthrough occurs, then your second option is much more likely.

Re:Ilya Sutskever to leave OpenAI by sangnoir on Tuesday May 14, 2024 @11:44PM (#40362882)
> Jevons paradox tells us that further massive amounts of training will occur in multi-modality and grounding models to reality

I was thinking along the lines of how Sun Microsystems and big-iron were dethroned by good-enough commodity x86 servers + Linux. The two coexisted... for a short while.

Re:Ilya Sutskever to leave OpenAI by pixl97 on Wednesday May 15, 2024 @10:59AM (#40367832)
All while x86 morphed to x64 and gained back many of the features of big iron.

Much of the problem with PC software at the time was one of scaling. Getting software to use multiple processors effectively took decades, but the cost difference and ability to actually get the hardware cheap allowed it to win the market... then grow back into systems with hundreds of cores and terabytes of memory because the needs for big iron didn't go away.

With AI/training/LLMs/NNs scale, at least appears, intrinsic. We see this in the animal world. We see insects with a very basic brain capable of interacting with the world and surviving. Then we see mammals with larger brains capable of far more as the scale/complexity/interconnectivity of their brains increases. At least from what we can tell, throwing more power at any given problem will give us a better solution.

Re:Ilya Sutskever to leave OpenAI by fallat on Tuesday May 14, 2024 @08:02PM (#40361540)
Yeah what. That guy above you is absolutely blind.
Re:Ilya Sutskever to leave OpenAI by weard_beard on Tuesday May 14, 2024 @08:18PM (#40361651)
AI is more like Apple and less like the internet. Your rabid fanaticism is what convinces me of its value… not it’s actual value.
Re:Ilya Sutskever to leave OpenAI by pixl97 on Tuesday May 14, 2024 @08:24PM (#40361691)
"Intelligence isn't valuable" --Guy on HN.
Re:Ilya Sutskever to leave OpenAI by twodave on Tuesday May 14, 2024 @08:30PM (#40361722)
Not all AI is hype. We are just surrounded by so much AI hype it’s easy to forget things like Co-pilot didn’t exist just a couple years ago. To say there’s no value in having an assistant to write code at your direction is incorrect.
Re:Ilya Sutskever to leave OpenAI by weard_beard on Tuesday May 14, 2024 @09:23PM (#40362096)
The iPhone was legitimately revolutionary. I’m not disagreeing with you. I don’t see its value surviving commoditization.
Re:Ilya Sutskever to leave OpenAI by lannisterstark on Tuesday May 14, 2024 @08:51PM (#40361858)
>Your rabid fanaticism

Recognizing value isn't "Rabid fanaticism" lol.

Re:Ilya Sutskever to leave OpenAI by localfirst on Tuesday May 14, 2024 @08:48PM (#40361831)
Except 24 years ago you didn't need Cisco to write HTML. Your analogy is not correct and it tells me you didn't bother to read my edit.

I really shouldn't have to explain how this bubble ends.

Re:Ilya Sutskever to leave OpenAI by baobabKoodaa on Tuesday May 14, 2024 @09:01PM (#40361945)
Stock prices go up and down. A stock downswing very rarely has economical consequences for the company whose stock it is, and even more rarely does it have such consequences for other companies.