News for hackers. Stuff that matters.
Re:Algorithms Have Already Gone Rogue by jordigh on Friday October 06, 2017 @10:49AM (#15417186)
Is this his new meme-hustling? "Algorithm"?

https://thebaffler.com/salvos/the-meme-hustler

I've never liked how Tim O'Reilly frames his discussion around vague terms like "open" which could mean participatory, transparent, available, or any other number of vague, feel-good terms. Now he seems to be calling "algorithm" things like economic models and government policy.

These are widely disparate things, but by using vague terms in different contexts, he pushes discussion towards the direction he wants to steer it: in the case of "open", away from free software. In the case of "Web 2.0", towards anything that involved crowd participation.

With "algorithms", he seems to be wanting to push the notion that technology is both scary but liberating and we need tech messiahs like Bezos or Musk to bring it under control.

Re:Algorithms Have Already Gone Rogue by tenaciousDaniel on Friday October 06, 2017 @11:02AM (#15417291)
That's been bothering me, the word "algorithm" is slowly becoming known as this ambiguously scary thing.
Re:Algorithms Have Already Gone Rogue by Chaebixi on Friday October 06, 2017 @11:27AM (#15417522)
It's kinda understandable, though. Whenever the services of Google, Facebook, etc. behave in an inscrutable, nonsensical, or offensive way, they blame it on their "algorithm" (for a recent example, see https://www.theguardian.com/us-news/2017/oct/06/youtube-alte...). That's really the only context where the term "algorithm" surfaces in mainstream discussion.

ML has had a lot of successes, but one of its failures has been more unpredictability on the level of individuals and events that people actually experience.

Re:Algorithms Have Already Gone Rogue by KirinDave on Friday October 06, 2017 @11:36AM (#15417607)
Maybe if humans took responsibility for the algorithms they created and didn't shrug and say, "It's the algorithm" then "the algorithm" wouldn't be the antagonists in this story.
Re:Algorithms Have Already Gone Rogue by gmfawcett on Friday October 06, 2017 @12:40PM (#15418157)
Even in that light, algorithms aren't the enemy: models are. If I build a predictive model that harms people, then my model is the cause of harm, not the fact that I built it using random-forest or CNN.
Re:Algorithms Have Already Gone Rogue by KirinDave on Friday October 06, 2017 @01:28PM (#15418542)
Models are algorithms with parameters.
Re:Algorithms Have Already Gone Rogue by coliveira on Friday October 06, 2017 @01:17PM (#15418464)
You should get used to that. When technology does harm, then the creators of this technology will point to the algorithm, the same way that Google talks about an algorithm as being a living thing. Of course, whenever they do good things, then the merit goes to the (human) creators of the algorithm -- in fact, to the founder(s) of the company that created the algorithm.
Re:Algorithms Have Already Gone Rogue by fmihaila on Friday October 06, 2017 @02:02PM (#15418875)
Yeah, 'algorithms' are the new 'chemicals'.
Re:Algorithms Have Already Gone Rogue by mfoy_ on Friday October 06, 2017 @11:30AM (#15417548)
An "algorithm" is simply a way to do a thing based on a set of rules to be followed... of course it's ambiguous.

Getting scared of anything that generic is silly. Might as well fear the outside because anything can happen out there!

Re:Algorithms Have Already Gone Rogue by AlexandrB on Friday October 06, 2017 @12:06PM (#15417884)
Throughout most of history rules and laws were enforced by a combination of "the letter of the law" and "the spirit of the law". The latter being shorthand for the role of human discretion.

Algorithms completely obliterate the latter - increasingly turning previously flexible systems into the equivalent of zero-tolerance-policy schools, where human discretion has no role to play. This is a problem because many laws on the books were written with the assumption that "the spirit of the law" would be a guiding principle when "the letter of the law" is unclear.

As a trivial example of this going terribly wrong, consider Youtube's copyright enforcement algorithms. Copyright was clearly designed with many loopholes for fair use to allow culture to move forward. Youtube's algorithms ignore all of this, changing the effective meaning of copyright on the site from one where the rights of the copyright owner are balanced with the rights of critics, commenters, and other creators to one where the rights of copyright owners are the only ones that matter.

Now imagine this kind of algorithmic enforcement applied to traffic laws, HR rules, or insurance policies and you can see why people might be nervous about "algorithms". Algorithms neither think nor feel and have no empathy. It's the ultimate actualization of the dystopia in the movie Brazil where the world is a cold, unfeeling, bureaucratic nightmare. Except where human bureaucrats at least need to sleep sometimes, computerized ones never rest.

Re:Algorithms Have Already Gone Rogue by rsync on Friday October 06, 2017 @03:10PM (#15419522)
"Now imagine this kind of algorithmic enforcement applied to traffic laws"

We already have this in the form of red light cameras which have been shown to cause rear-end accidents at traffic lights:

"There have been concerns that red light cameras scare drivers (who want to avoid a ticket) into more sudden stops, which may increase the risk of rear-end collisions."[1]

"the authors of the study found a statistically significant, but still smaller, reduction in angle and turning injury crashes by 15 percent, as well as 'a statistically significant increase of 22 percent in rear-end injury collisions."[2]

In short, there situations where the humans involved would all agree on what a "correct" driving response would be, but the presence of the algorithm (the camera, the ticket, the court, etc.) forces another action - and sometimes that action can be bewildering to other participants.

[1] https://en.wikipedia.org/wiki/Red_light_camera

[2] http://bigthink.com/ideafeed/study-red-light-cameras-ineffec...

Re:Algorithms Have Already Gone Rogue by gmfawcett on Friday October 06, 2017 @12:49PM (#15418235)
I write a faulty policy that harms people. I encode it as an algorithm, implement it as a program, and deploy it on a wide scale. Now it's automated and distributed, and it is harming people. Where is the fault --- in the program? in the algorithm? Or in the policy? Where do we fix the problem?

IMO, we are quick to blame inanimate constructs, when people and their policies are the source of fault. Vilifying "algorithms" only serves to distract from root causes.

Re:Algorithms Have Already Gone Rogue by AlexandrB on Friday October 06, 2017 @02:32PM (#15419161)
The argument I'm making is that when it comes to "human systems" like communities it's not possible to write a complete, consistent, and fair policy that can be unambiguously interpreted (i.e. by a computer). This is why Hacker News still has moderators and is not strictly governed by algorithms.

"Fairness" has always been heavily contextual, and the idea that it can be distilled to a matter of "if A and B then C" is folly. Even pure math can't reach the combination of completeness and consistency you assume is possible: https://en.m.wikipedia.org/wiki/Gödel%27s_incompleteness_the...

Re:Algorithms Have Already Gone Rogue by __s on Friday October 06, 2017 @07:49PM (#15421315)
Human judgement can't escape Gödel
Re:Algorithms Have Already Gone Rogue by Chaebixi on Friday October 06, 2017 @02:42PM (#15419260)
> Vilifying "algorithms" only serves to distract from root causes.

But that's the goal of some actors. They want to misdirect attention and responsibility away from themselves when their creations misbehave.

The root cause is no-one is really at the wheel once the algorithm goes into production to provide human discretion. For instance, pretty much the entire consumer facing apparatus of Google and Facebook consists of "algorithms" and there's no one empowered to call when they go wrong. Fixing that would cost money that the tech giants don't want to spend.

Re:Algorithms Have Already Gone Rogue by PeterisP on Friday October 06, 2017 @02:57PM (#15419406)
The point seems to be that is you limit your policy to something that can be reasonably be encoded as an algorithm and implemented as a program then you're by definition limited to write faulty policies that can't be flexible enough and will harm people.

I.e., that if you're choosing to use an algorithm for your policy, then this means that you will write harmful policies, and the choice to use an algorithm at all, any algorithm, is morally flawed and should be vilified - to motivate you and others to write policies that include appropriate flexibility, arbitration, human evaluation, overrides and thus can't be implemented as a scalable algorithm/program. Well, not unless we get superhuman general AI systems.

Re:Algorithms Have Already Gone Rogue by tenaciousDaniel on Friday October 06, 2017 @01:23PM (#15418501)
Algorithm is an ambiguous word, but when people refer to them in the scary context, they are particularly talking about the kinds of algorithms the giants use to analyze and predict behavior. My only concern is that the word itself becomes associated with that one use case, which would be kind of sad because algorithms make up pretty much all software period.
Re:Algorithms Have Already Gone Rogue by s73ver_ on Friday October 06, 2017 @12:05PM (#15417883)
It's quite not, actually. Humans have the ability to see nuance in things. Computers currently don't. So you see things like Google banning developers for innocuous violations of the rules, whereas humans (assuming they were given enough time to properly review) wouldn't give 3 strikes just because they saw the same violation 3 times.
Re:Algorithms Have Already Gone Rogue by mfoy_ on Friday October 06, 2017 @01:07PM (#15418375)
No, that really is the definition of an algorithm.

Algorithms and computers are NOT inextricably linked. Just because software often uses algorithms to define behaviour, doesn't mean algorithms cannot mean other things.

Re:Algorithms Have Already Gone Rogue by s73ver_ on Friday October 06, 2017 @01:43PM (#15418699)
In the context being discussed, computers are involved and are the ones making the decisions.
Re:Algorithms Have Already Gone Rogue by mfoy_ on Friday October 06, 2017 @02:24PM (#15419074)
That's not the context of this discussion. Refer to the parent comment: https://news.ycombinator.com/item?id=15417291

The context is the word "algorithm".

Re:Algorithms Have Already Gone Rogue by zghst on Friday October 06, 2017 @11:21AM (#15417471)
Everyday people couldn't even tell you the definition of "algorithm", even then, they wouldn't recognize that algorithms are not only encoded into chips but also business process, legal compliance, etc.
Re:Algorithms Have Already Gone Rogue by mattkrause on Friday October 06, 2017 @09:42PM (#15421767)
To be fair, it's very hard to precisely define "algorithm" and actual, working scientists and philosophers have been arguing about this for ages:

https://en.wikipedia.org/wiki/Algorithm_characterizations

Re:Algorithms Have Already Gone Rogue by sukilot on Friday October 06, 2017 @01:15PM (#15418433)
O'Reilly's in an interesting story. He became fabulously wealth by selling partly/mostly closed-source books about open-source software, in the short time-window when opens source existed while it was also possible to make money selling books (before Internet samizdat became cheap as free)
Re:Algorithms Have Already Gone Rogue by packetslave on Friday October 06, 2017 @02:02PM (#15418868)
WTF is a "closed-source book"?
Re:Algorithms Have Already Gone Rogue by cujic9 on Friday October 06, 2017 @02:53PM (#15419361)
The opposite of an open source book.

I'd assume the parent is thinking of something like the "Pro Git" book, available on Github as code and licensed under creative commons. https://github.com/progit/progit2