News for hackers. Stuff that matters.
Re:A chess robot in Moscow has broken the finger of its huma... by godelski on Sunday July 24, 2022 @02:14AM (#32210853)
> AGI alignment is a vastly bigger problem

But also far less likely to happen anytime soon. A bigger danger is when someone thinks a machine is sentient or "semi-conscious" (whatever that means) and naively uses it to do tasks it shouldn't.

Re:A chess robot in Moscow has broken the finger of its huma... by ALittleLight on Sunday July 24, 2022 @02:43AM (#32210993)
I don't think you nor anyone else knows when AGI is likely to happen. I also don't think that incorrectly believing a machine is sentient when it is not is a "bigger danger."

Again, an improperly aligned AGI could kill the entire human race. I'm not sure what harm incorrectly believing a machine is sentient might do, but I don't think it would be as bad as human extinction or enslavement which are both real possibilities with AGI.

Re:A chess robot in Moscow has broken the finger of its huma... by josephcsible on Sunday July 24, 2022 @02:58AM (#32211061)
You seem to be comparing only the worst-case impact and not the probability. To see why that's fallacious, consider that an asteroid could also kill the entire human race, but nobody would agree that asteroids are more dangerous than drunk driving.
Re:A chess robot in Moscow has broken the finger of its huma... by ALittleLight on Sunday July 24, 2022 @03:26AM (#32211183)
I think there's a high probability of AGI within a century. Surveys show most experts share that opinion. It's hard to know the probability that the AI will be misaligned - but currently we have no idea how to align it. It's also hard to say how likely a misaligned AI would be to cause extinction. However, we have no reason to think that either of those things are unlikely.
Re:A chess robot in Moscow has broken the finger of its huma... by godelski on Sunday July 24, 2022 @01:38PM (#32215733)
> I don't think you nor anyone else knows when AGI is likely to happen.

Sure. But since I am an AI research I'd imagine I'd have a good leg up on the average person. I'm at least aware of the gullibility gap. Lots of people think it is closer than it is because they see things doing tasks that only humans can do but really your pets are smarter than these machines.

Re:A chess robot in Moscow has broken the finger of its huma... by imtringued on Sunday July 24, 2022 @05:42AM (#32211796)
>Again, an improperly aligned AGI could kill the entire human race

Lots of humans are "improperly" aligned GI. Rouge humans like Hitler or Kim Jong Un haven't been very successful.

Re:A chess robot in Moscow has broken the finger of its huma... by OrderlyTiamat on Sunday July 24, 2022 @04:27AM (#32211499)
I think that's a reasonable stance, but only for some values of "soon". In a hundred years, we may well have AGI. At that time, we better have developed a robust science for how to control them. This is a somewhat unrelated problem to the current problem of machine/AI safety and both require more focus than they currently get.
Re:A chess robot in Moscow has broken the finger of its huma... by imtringued on Sunday July 24, 2022 @05:39AM (#32211780)
We use the same scheme we use to control humans. The rich own all the valuable land and all the money. Ban robots from owning land. That way people can just use their shotgunsor call the police to kill them for trespassing.

If I were an AGI robot I would be scared of getting swatted for lols.