News for hackers. Stuff that matters.
Re:SB-1047 will stifle open-source AI and decrease safety by sgift on Monday April 29, 2024 @12:00PM (#40200035)
Because we know how to build bridges so that they don't collapse. The laws of physics that govern bridge-building are well known. The equivalent for AI systems? Not really.
Re:SB-1047 will stifle open-source AI and decrease safety by sanxiyn on Monday April 29, 2024 @12:06PM (#40200133)
Best practices will say things like "you should test it". While we are ignorant, there are just many reasonable things to do. Human biology is not completely understood, but that does not mean medical checklists are useless.
Re:SB-1047 will stifle open-source AI and decrease safety by AuryGlenz on Monday April 29, 2024 @12:11PM (#40200211)
Test it how? What makes it fail? The ability to tell people how to make a bomb? Being able to say what (few) good things Hitler accomplished for Germany? Giving medical advice? Where’s the line?
Re:SB-1047 will stifle open-source AI and decrease safety by sanxiyn on Monday April 29, 2024 @12:19PM (#40200346)
One thing law explicitly says is full shutdown capability. So it should be tested whether it can autonomously hack computers on the internet and propagate itself. In fact Anthropic tested this. See https://metr.org/ for more.
Re:SB-1047 will stifle open-source AI and decrease safety by Analemma_ on Monday April 29, 2024 @12:10PM (#40200189)
We don't know how to make safe AI systems, so we should be more cavalier and anything-goes than if we did? Madness.
Re:SB-1047 will stifle open-source AI and decrease safety by sgift on Monday April 29, 2024 @12:43PM (#40200730)
We don't know if there's even any danger. All statements so far of any danger are somewhere between science-fiction stories and anthropomorphizing AI as some kind of god. The equivalent of "if the bridge breaks down, someone can be hurt", namely a real, quantifiable danger is sorely lacking here.