Re:Meta disbanded its Responsible AI team
by riversflow on Sunday November 19, 2023 @06:19PM
(#38339674)
AI alignment is sort of like computer security except computer security is a real pressing problem and AI alignment is based on science fiction.
Re:Meta disbanded its Responsible AI team
by 0xDEAFBEAD on Sunday November 19, 2023 @06:55PM
(#38340034)
Suppose you were working on an early mission-critical computer system. Your coworker is thinking about a potential security issue. You say: "Yeah I read about that in a science fiction story. It's not something we need to worry about." Would that be a valid argument for you to make?
It seems to me that you should engage with the substance of your coworker's argument. Reading about something in science fiction doesn't prevent it from happening.
Re:Meta disbanded its Responsible AI team
by didntcheck on Monday November 20, 2023 @04:28AM
(#38345364)
In this analogy it's not your coworker. It's some layman (despite self-declared expertise) standing outside and claiming he's spotted a major security issue based on guesses about how such systems will work
From what I have observed the reaction of most people working in the AI to "What do you think of Yudkowsky?" is "Who?". He's not being ignored out of pride or spite, he just has no qualifications or real involvement in the field
In the same way, much of AI alignment consists of thinking about hypothetical failure modes of advanced AI systems and how to mitigate them. I think this specific paper is especially useful for understanding the technical background that motivates Eliezer's tweeting: https://arxiv.org/pdf/1906.01820.pdf