News for hackers. Stuff that matters.
Re:How We’ll Know an AI Is Conscious by ilaksh on Monday March 29, 2021 @08:56AM (#26620840)
But we really, really don't want to give robots survival instincts..

Maybe pain in a very limited sense.

There actually has been work on AGI emotions. Search "Want NARS emotional".

Re:How We’ll Know an AI Is Conscious by anotheryou on Monday March 29, 2021 @03:30PM (#26627050)
Didn't say we should. But any goal given is quite close to that as death would prevent the goal from being reached.

Optimizing for something is even more common and even worse: https://en.wikipedia.org/wiki/Instrumental_convergence#Paper...