News for hackers. Stuff that matters.
Re:Faulty Reward Functions in the Wild by ludbb on Wednesday December 21, 2016 @10:41PM (#13234599)
And I thought I was pessimistic. I must be missing something, how did we go from a faulty code, to KPIs, to Comcast paving the future of the AI?
Re:Faulty Reward Functions in the Wild by Ironchefpython on Wednesday December 21, 2016 @11:05PM (#13234710)
> how did we go from a faulty code

The code in the example isn't faulty. The goals are faulty in an non-obvious way, and drives the AI to optimize a solution to a fitness function in a way that humans might consider pathological behavior.

> to Comcast paving the future of the AI?

Comcast's goals are faulty in a non-obvious way. Comcast's goals are to maximize shareholder profit, and in doing so creates a culture of fraudulent billing and a horrifying gauntlet of a cancellation process that humans might consider pathological behavior. And AI is the next logical step to optimizing those corporate values.

Re:Faulty Reward Functions in the Wild by marcosdumay on Thursday December 22, 2016 @11:54AM (#13238488)
> Comcast's goals are to maximize shareholder profit

It's nitpicking, but no, no big company has the goal of maximizing shareholder profit.

Most have the goal of maximizing board members profit, what is mostly aligned, but different in a non-obvious way from maximizing shareholder profit.

Re:Faulty Reward Functions in the Wild by Terr_ on Thursday December 22, 2016 @01:07PM (#13239086)
> Comcast paving the future of the AI?

I think the core point is that corporations are fairly general-purpose machines, designed to do things too "big" for individual people. (But smaller and easier to analyze than "civilization.")

Their hardware stack is different, but lessons about their computational structure and design pitfalls may be applicable.