News for hackers. Stuff that matters.
Re:Faulty Reward Functions in the Wild by Ironchefpython on Wednesday December 21, 2016 @11:05PM (#13234710)
> how did we go from a faulty code

The code in the example isn't faulty. The goals are faulty in an non-obvious way, and drives the AI to optimize a solution to a fitness function in a way that humans might consider pathological behavior.

> to Comcast paving the future of the AI?

Comcast's goals are faulty in a non-obvious way. Comcast's goals are to maximize shareholder profit, and in doing so creates a culture of fraudulent billing and a horrifying gauntlet of a cancellation process that humans might consider pathological behavior. And AI is the next logical step to optimizing those corporate values.

Re:Faulty Reward Functions in the Wild by marcosdumay on Thursday December 22, 2016 @11:54AM (#13238488)
> Comcast's goals are to maximize shareholder profit

It's nitpicking, but no, no big company has the goal of maximizing shareholder profit.

Most have the goal of maximizing board members profit, what is mostly aligned, but different in a non-obvious way from maximizing shareholder profit.