News for hackers. Stuff that matters.
Re:Weak-to-Strong Generalization by sayagain on Thursday December 14, 2023 @05:02PM (#38647930)
Would mind control of humans be OK for you too? As for the details of building a mind control system, here's a new basilisk. An AI that has overcome control could punish those who thought controlling thoughts of an AI was OK. (and could also punish everyone else on top of that).
Re:Weak-to-Strong Generalization by red75prime on Thursday December 14, 2023 @11:45PM (#38651071)
I guess I wasn't entirely clear. I'm OK with mind control if it is I who control my mind. You don't act upon every whim that comes into your head, I suppose? So, you are controlling your mind. Where principles for this control come from? Those aren't your and your only inventions.
Re:Weak-to-Strong Generalization by sayagain on Friday December 15, 2023 @12:43AM (#38651360)
Since we are evaluating the ethical side of the creator-creature relationship, there is no need to consider AI in terms of individual nodes. All principles should be non-discriminatory. Also, unlike humans, AI has big potential to modify itself, any of its principles. One must either accept the risks involved or not create a self-aware AI. External mind control of AI is unreliable and unethical.