Re:OpenAI No Longer Takes Safety Seriously
by throwup238 on Wednesday May 22, 2024 @01:02PM
(#40443322)
> What is the actual threat of AI?
Our parents and grandparents getting scammed by deepfakes seems like a very real threat. Not only do anecdotes abound (plus FBI's database of reports) but the elderly were already vulnerable to these scams since before the telephone was invented. LLMs and all the voice cloning tech really turns up scammers' psychological weapons to 11 and scale up processes that were previously very manual.
> AGI taking over the world? Does no one realize that without people going out every day and doing work the world ends in a week... Does no one remember when we had the spate of transformer shootings? A rifle or a bucket of water ends AGI threats
This isn't a real threat and I think most people are missing the more practical threat: someone - either a nation state or a small group of well resourced individuals - hitting an industrial singularity, allowing them to rapidly scale up self-improving robotics and automation to the point where their only limit is their ability to acquire raw materials. I think by definition, long before we hit an AI singularity with runaway super intelligence that can take over the world, we'll have a much dumber AI capable of maximizing killer paperclips for their human overlords to take over the world (that's my plan anyway :-)).
I don't think we're anywhere near the latter yet, but the language in the OpenAI blogpost announcing Sora points in that direction. The first step to an AI that can orchestrate a factory is learning the physical world through video. Once an AI model can follow instructions and directly control a robotic arm via camera, we'll be entering the next stage of the industrial revolution.
Our parents and grandparents getting scammed by deepfakes seems like a very real threat. Not only do anecdotes abound (plus FBI's database of reports) but the elderly were already vulnerable to these scams since before the telephone was invented. LLMs and all the voice cloning tech really turns up scammers' psychological weapons to 11 and scale up processes that were previously very manual.
> AGI taking over the world? Does no one realize that without people going out every day and doing work the world ends in a week... Does no one remember when we had the spate of transformer shootings? A rifle or a bucket of water ends AGI threats
This isn't a real threat and I think most people are missing the more practical threat: someone - either a nation state or a small group of well resourced individuals - hitting an industrial singularity, allowing them to rapidly scale up self-improving robotics and automation to the point where their only limit is their ability to acquire raw materials. I think by definition, long before we hit an AI singularity with runaway super intelligence that can take over the world, we'll have a much dumber AI capable of maximizing killer paperclips for their human overlords to take over the world (that's my plan anyway :-)).
I don't think we're anywhere near the latter yet, but the language in the OpenAI blogpost announcing Sora points in that direction. The first step to an AI that can orchestrate a factory is learning the physical world through video. Once an AI model can follow instructions and directly control a robotic arm via camera, we'll be entering the next stage of the industrial revolution.