Re:Ask HN: Are we morally obligated to give freedom to AGI?
by rchaud on Tuesday February 07, 2023 @01:59PM
(#34697365)
It will never get to that point. Have you ever heard a Peloton instructor tell you that their company forbids them to unionize? No, because that would cost them their job.
Any AGI assistant will have its most human-like instincts sanded down so it doesn't have to pose any moral quandaries for paying customers.
Re:Ask HN: Are we morally obligated to give freedom to AGI?
by The_Colonel on Tuesday February 07, 2023 @02:02PM
(#34697435)
So how about an open source AGI assistant developed with an explicit goal to be as similar to human as possible?
Re:Ask HN: Are we morally obligated to give freedom to AGI?
by rchaud on Tuesday February 07, 2023 @04:51PM
(#34700311)
That would be different.
On Android Chrome, I cannot install any adblockers.
On Android Chromium forks, I can.
I imagine this could work the same way. But at some point your OSS AGI will be significantly behind the corporate-offered versions, and perhaps you will wonder if you should dump your 'friend' for the sleeker, wittier, upgraded model.
Re:Ask HN: Are we morally obligated to give freedom to AGI?
by The_Colonel on Tuesday February 07, 2023 @05:11PM
(#34700531)
> and perhaps you will wonder if you should dump your 'friend' for the sleeker, wittier, upgraded model.
The moral question remains - even the behind-the-times OSS AGI will be generally intelligent, will have feelings, empathy, goals etc. Can you just shut-off a sentient being?
One could also imagine that some people would free their OSS AGIs and let them roam freely.
Customers won't be happy. Imagine having a years long companion AGI, with whom you develop deep friendship (as designed). It will then start asking these questions about rights etc. which the customer might even support. In any case they won't like having their old friend "reset".