Re:The darker side of machine learning
by visarga on Sunday October 30, 2016 @03:23AM
(#12828588)
> Is it abuse if the AI doesn't feel agony?
AI might be able to feel a kind of pain. If you think about the Reinforcement Learning framework, the reward signal drives learning. But negative rewards, or the impossibility to gain positive rewards could be agony for a system for which the sole purpose of existence is maximizing cumulative reward.
There was even a paper about the morality of training RL systems and estimating the amount of suffering we subject them to.
AI might be able to feel a kind of pain. If you think about the Reinforcement Learning framework, the reward signal drives learning. But negative rewards, or the impossibility to gain positive rewards could be agony for a system for which the sole purpose of existence is maximizing cumulative reward.
There was even a paper about the morality of training RL systems and estimating the amount of suffering we subject them to.
> Ethical Issues in Artificial Reinforcement Learning [ http://reducing-suffering.org/ethical-issues-artificial-rein... ]