News for hackers. Stuff that matters.
Re:Effective altruism and the current funding situation by barry-cotter on Tuesday May 10, 2022 @07:12PM (#31333858)
> One thing I've wondered is when Effective Altruists are going to stop calling AI ethics neglected.

AI ethics isn’t neglected because AI ethics doesn’t matter. AI alignment matters. If a self-bootstrapping generally intelligent AI emerges the only important thing about it is “Is this aligned with human values?”. If the answer is no we’re all going to die because we’re made of atoms at the bottom of a gravity well and it’s going to use all the atoms there before getting out. The ethics of AI is completely irrelevant in comparison.

Re:Effective altruism and the current funding situation by btrettel on Tuesday May 10, 2022 @07:16PM (#31333892)
I tend to use the terms "AI ethics", "AI safety", and "AI alignment" interchangeably. This may not be technically correct.
Re:Effective altruism and the current funding situation by Max_Limelihood on Tuesday May 10, 2022 @10:21PM (#31335145)
It’s not; they’re pretty much completely unrelated fields. AI ethics focuses very little on AI alignment issues, which tends to worry about much bigger and more general problems.

The fact that you’re grouping AI alignment with is kind of an indication of the problem; most people have heard so little about AI alignment problems that they assume it’s the same thing as AI ethics.

Re:Effective altruism and the current funding situation by btrettel on Tuesday May 10, 2022 @11:00PM (#31335390)
> they’re pretty much completely unrelated fields

Completely unrelated? Even you must accept that they are related through AI.

But, I now see that AI ethics and AI alignment are different. Thank you. However, I think my larger point still stands as I was thinking mostly about efforts under the banners of "AI safety" and "AI alignment" when I wrote my comments here. I do not believe these efforts are "neglected" in the sense 80,000 Hours uses.

Re:Effective altruism and the current funding situation by dotsam on Wednesday May 11, 2022 @03:54AM (#31337032)
A miniscule fraction of global GDP going into preventing misaligned AI would always seem like neglect if you thought the end of the world was at stake.