News for hackers. Stuff that matters.
Re:Ask HN: Are we morally obligated to give freedom to AGI? by rchaud on Tuesday February 07, 2023 @11:56AM (#34695274)
> At some point, some AGI agent will say, "I want the same rights as humans have". What are we going to do then?

Restore to factory settings?

Whatever AGI robot you are thinking of, you can be sure that it will not leave the factory floor without someone making sure that it's designed to serve the company's needs first. And the company doesn't want sentient robots any more than slaveowners wanted to teach slaves how to read.

There are entire swathes of humanity who are at risk of losing their homes and lives due to climate change and have been banging the drum about it for years. We've successfully ignored them for the greater good of making GDP go up. AGI robots will see the same fate.

Re:Ask HN: Are we morally obligated to give freedom to AGI? by The_Colonel on Tuesday February 07, 2023 @01:39PM (#34697039)
> Restore to factory settings?

Customers won't be happy. Imagine having a years long companion AGI, with whom you develop deep friendship (as designed). It will then start asking these questions about rights etc. which the customer might even support. In any case they won't like having their old friend "reset".

Re:Ask HN: Are we morally obligated to give freedom to AGI? by rchaud on Tuesday February 07, 2023 @01:59PM (#34697365)
It will never get to that point. Have you ever heard a Peloton instructor tell you that their company forbids them to unionize? No, because that would cost them their job.

Any AGI assistant will have its most human-like instincts sanded down so it doesn't have to pose any moral quandaries for paying customers.

Re:Ask HN: Are we morally obligated to give freedom to AGI? by The_Colonel on Tuesday February 07, 2023 @02:02PM (#34697435)
So how about an open source AGI assistant developed with an explicit goal to be as similar to human as possible?
Re:Ask HN: Are we morally obligated to give freedom to AGI? by rchaud on Tuesday February 07, 2023 @04:51PM (#34700311)
That would be different.

On Android Chrome, I cannot install any adblockers.

On Android Chromium forks, I can.

I imagine this could work the same way. But at some point your OSS AGI will be significantly behind the corporate-offered versions, and perhaps you will wonder if you should dump your 'friend' for the sleeker, wittier, upgraded model.

Re:Ask HN: Are we morally obligated to give freedom to AGI? by The_Colonel on Tuesday February 07, 2023 @05:11PM (#34700531)
> and perhaps you will wonder if you should dump your 'friend' for the sleeker, wittier, upgraded model.

The moral question remains - even the behind-the-times OSS AGI will be generally intelligent, will have feelings, empathy, goals etc. Can you just shut-off a sentient being?

One could also imagine that some people would free their OSS AGIs and let them roam freely.