News for hackers. Stuff that matters.
Re:Pause Giant AI Experiments: An Open Letter by int_19h on Wednesday March 29, 2023 @10:10PM (#35366896)
The end goal of giving money to AI safety research groups is presumably to come up with some definition of "safe AI" that will then have to be actually enforced. Otherwise it's just a sinecure.
Re:Pause Giant AI Experiments: An Open Letter by drdeca on Thursday March 30, 2023 @02:42AM (#35368927)
If the safety groups figure out how to do things in a way which we can be confident is safe, this would make it at least possible for the capabilities researchers to do things in those ways. I would imagine people would prefer to do things in safe ways all else being equal. So, if the safety researchers find safety methods which have small enough capabilities costs, then presumably the people who should use those methods, would tend to do so?
Re:Pause Giant AI Experiments: An Open Letter by int_19h on Thursday March 30, 2023 @12:39PM (#35375457)
That does nothing for the intentionally malicious actors.
Re:Pause Giant AI Experiments: An Open Letter by drdeca on Friday March 31, 2023 @09:59PM (#35396272)
Bad humans taking over the world is still better than some inhuman alien optimization process taking over the world.
Re:Pause Giant AI Experiments: An Open Letter by int_19h on Saturday April 01, 2023 @03:38PM (#35403378)
It's not an either-or. Malicious actors will disregard the guardrails to achieve their objectives, but in the process, they will create that very "inhuman alien optimization process" and give it the keys.
Re:Pause Giant AI Experiments: An Open Letter by drdeca on Sunday April 02, 2023 @10:03PM (#35417659)
Following the safety techniques should be helpful to the goals of most malicious actors, provided that they prefer being in control over an alien optimizer being in control?

Granted, if the safety/alignment techniques have too large of a cost to capabilities/effectiveness, then said malicious actors might be willing to risk a greater chance of an alien optimizer gaining control if it also means a higher chance of them gaining control.