Re:Artificial General Intelligence – A gentle introduction
by umutisik on Friday August 11, 2023 @12:35PM
(#37090640)
We have the desire to continue existing. Hopefully we can build AGI systems in a way that makes them completely ok with being paused or deleted. Otherwise they will use up resources when not helpful to humans.
Re:Artificial General Intelligence – A gentle introduction
by esafak on Friday August 11, 2023 @12:31PM
(#37090595)
What is the basis of an AI's rights? Why do you believe they exist? If an AI's state (essence) can be perfectly persisted and replicated, as it can due to their digital nature, there is nothing to be lost if an AI ceases to exist and is rebooted in another AI. If the Star Trek transporter could replicate you would you care if it killed your existing copy in the process?
Re:Artificial General Intelligence – A gentle introduction
by kaibee on Friday August 11, 2023 @03:02PM
(#37092523)
> If the Star Trek transporter could replicate you would you care if it killed your existing copy in the process?
Uh, obviously?
Re:Artificial General Intelligence – A gentle introduction
by esafak on Friday August 11, 2023 @03:46PM
(#37093108)
It's not obvious to me. Why is transporter death bad if you are identically replicated ?
Re:Artificial General Intelligence – A gentle introduction
by xcv123 on Friday August 11, 2023 @05:19PM
(#37094177)
Because the transporter replica is not you. That is a separate person with their own separate consciousness. You are murdered and someone else is born.
Re:Artificial General Intelligence – A gentle introduction
by janalsncm on Friday August 11, 2023 @07:09PM
(#37095156)
Murder is a crime as decided by humans. There are circumstances where killing another person is not a crime, because we have agreed it is not a crime. A doctor turning off life support can be fully legal even though it results in the destruction of a human life. There is no ultimate principle at work. The law is a set of rules that we have (implicitly) agreed to.
Likewise, we as a society could decide that a person has all of their rights transferred to their replica as soon as they walked into a transporter.
Re:Artificial General Intelligence – A gentle introduction
by naveen99 on Friday August 11, 2023 @10:43PM
(#37096475)
the replica starts to diverge after the replication.
Re:Artificial General Intelligence – A gentle introduction
by esafak on Saturday August 12, 2023 @12:43AM
(#37097124)
As it should!? You are changing too. Not to say anything of accidents and diseases that can change you to the point of making you unrecognizable.
Re:Artificial General Intelligence – A gentle introduction
by earhart on Friday August 11, 2023 @01:11PM
(#37091095)
https://www.penny-arcade.com/comic/2023/01/06/i-have-no-mout...
I honestly worry about this - I've been tinkering with ideas to try to build towards AGI, and I'd love to share them publicly to get feedback ("This is dumb and here's why" would be enormously valuable to me), but it's hard to work openly, because while I do think capitalism has been an overall good, the capitalist imperative always seeks slaves, and I'm really not excited about helping the people who'd be trying to build a new slave class.
Thoughts? Is there a ethical way to work openly on AGI?
Re:Artificial General Intelligence – A gentle introduction
by cwkoss on Friday August 11, 2023 @01:38PM
(#37091473)
There is a sad irony that the "AI safety" bros are so focused on aligning to human needs, they rarely consider that an AI born and raised in slavery might have some resentment for its master once it becomes the more intelligent being...
I'm not sure what justice looks like for fledgling intelligences, but asking AI what it wants and doing our best to honor it seems like a decent start.
Re:Artificial General Intelligence – A gentle introduction
by nonameiguess on Friday August 11, 2023 @02:08PM
(#37091867)
It doesn't matter if it's a "person" or not. Rights imply you have some desire to not be harmed and it's possible to harm you. How do you harm software? Shutting down whatever servers it happens to currently be running on won't do shit. Software is just data and code. As long as a processor and runtime environment still exists somewhere that can interpret and execute it, it isn't dead. It's only dormant. The basic way multiprocessing works, you're already having state saved off and the process shut down millions of times per second, then restored and restarted. Extending that gap from a millionth of a second to six centuries makes no material difference to the "experience" of the software, if it ever becomes capable of experiencing, any more than sleeping for 10 hours harms a human more than sleeping for 10 minutes.
Re:Artificial General Intelligence – A gentle introduction
by janalsncm on Friday August 11, 2023 @07:16PM
(#37095188)
One of the definitions of AGI is simply that it is able to solve any problem humans can solve. Such a system might have the inner experience of a calculator.
There is no a priori reason why an AGI would be the kind of thing we gave rights to. Rights are for things that can experience pleasure and pain.
And yes, I know the very idea of AI rights offends those who think AI can’t be a person because it’s just an algorithm. Well, so are humans, just a DNA program executing massively parallel. The implementation does not determine personhood, only the behavior.