News for hackers. Stuff that matters.
Re:A Digital Rumor Should Never Lead to a Police Raid by Bartweiss on Thursday September 22, 2016 @02:41PM (#12559092)
I really appreciate this analogy, actually.

It's hard to construct a principled, narrow argument against profiling. If you have a single piece of exclusionary information, it's ludicrous to conduct a bunch of searches which are guaranteed to be worthless in the name of equality. (Leaving aside the accuracy of the tip for now.) And yet on a broader level, it's apparent that profiling can have all kinds of awful side effects.

An obvious example (and the metaphor carries) is secondary crimes discovered in the course of an investigation. There's another narrowly sensible rule: if a cop stops you for a broken taillight, they shouldn't have to ignore a corpse sitting in your passenger's seat. But combined with profiling, it produces a system where often-profiled people get the law enforced against them far more harshly than other groups. Add to that the cost and stigma of being investigated (a day in jail while innocent is a great way to lose a job), and you have a system where utterly sensible enforcement produces consistently biased harms.

The metaphor here carries really well. Imagine if those Kansas farmers torrented a bunch of movies, or that Seattle privacy advocate had a bit of marijuana. Well, those things are illegal, but it's still not fair that shoddy profiling amounts to selective enforcement against the profiled.

Even if you never, ever get incorrect data or wrongfully convict someone, profiling with limited data causes all kinds of secondary harms. This is a great non-racial example of why we should worry about it regardless of accuracy.

Re:A Digital Rumor Should Never Lead to a Police Raid by AnthonyMouse on Thursday September 22, 2016 @04:15PM (#12559968)
> If you have a single piece of exclusionary information, it's ludicrous to conduct a bunch of searches which are guaranteed to be worthless in the name of equality. (Leaving aside the accuracy of the tip for now.) And yet on a broader level, it's apparent that profiling can have all kinds of awful side effects.

The problem is that the main true benefit of the information is to exclude people, but that isn't how people use it.

Suppose there are 2 million people in an area and you know some demographic information about the perpetrator that will allow 95% of them to be excluded. That is useful information.

But the probability that a random person in the relevant demographic is the perpetrator is now 0.001%. The demographic contains 100,000 people and one perpetrator.

The fallacy is in assuming that just because not being in the relevant demographic is enough to exclude you, that being in the relevant demographic should by itself be enough to suspect you.

Re:A Digital Rumor Should Never Lead to a Police Raid by TrevorJ on Thursday September 22, 2016 @05:27PM (#12560510)
That's an excellent point that I have not heard before, thank you for this.
Re:A Digital Rumor Should Never Lead to a Police Raid by andreyvit on Friday September 23, 2016 @01:06AM (#12562447)
It's a textbook case of base rate fallacy. [1]

[1] https://en.wikipedia.org/wiki/Base_rate_fallacy

Re:A Digital Rumor Should Never Lead to a Police Raid by n72 on Friday September 23, 2016 @04:21AM (#12563101)
No, it's not. BRF has two components: Generic information about the frequency of events and specific information about the case in question. The item in question doesn't contain these. The item in question is a much simpler point.
Re:A Digital Rumor Should Never Lead to a Police Raid by voxic11 on Thursday September 22, 2016 @07:17PM (#12561139)
It's basically deductive vs inductive reasoning.
Re:A Digital Rumor Should Never Lead to a Police Raid by ekianjo on Friday September 23, 2016 @01:52AM (#12562597)
> But the probability that a random person in the relevant demographic is the perpetrator is now 0.001%. The demographic contains 100,000 people and one perpetrator.

That's still a much higher probability than 1/(2 000 000) so I am not sure what is your point there to use numbers.

Re:A Digital Rumor Should Never Lead to a Police Raid by rtpg on Friday September 23, 2016 @04:16AM (#12563086)
the point is that it's not a useful indicator for stopping random people.

"Oh, to catch the thief we are going to stop 100000 people" sounds absurd, after all.

Of course you can use the clue to exclude a bunch of people, but were you going to go around arresting random people on the street without this? Of course not, so why do it after.

Re:A Digital Rumor Should Never Lead to a Police Raid by dogma1138 on Thursday September 22, 2016 @03:45PM (#12559720)
Just to say something eye witness reports for race and any other characteristics are horribly inaccurate.

There are more than enough documented cases of rape, assault and other crime in which the victim could not identify the perpetrator with any degree of certainty.

Profiling is an important tool in law enforcement but it works when it's built on proper evidence and statistical models not sketchy witness reports.

Re:A Digital Rumor Should Never Lead to a Police Raid by Bartweiss on Thursday September 22, 2016 @04:12PM (#12559946)
Absolutely, and I'm glad you brought it up.

I skipped accuracy to observe that even correct profiling has problems, but it's hugely important to see that over-reliance on profiling is a threat to solving cases.

Re:A Digital Rumor Should Never Lead to a Police Raid by Manishearth on Friday September 23, 2016 @03:00AM (#12562834)
The Illustrated Guide to Law has tons on this in the criminal procedure section (http://lawcomic.net/guide/?page_id=5#crimpro)

The memory and facial recognition stuff starts here http://lawcomic.net/guide/?p=3034

Re:A Digital Rumor Should Never Lead to a Police Raid by baddox on Thursday September 22, 2016 @05:18PM (#12560449)
> (Leaving aside the accuracy of the tip for now.)

You hand-wave this part away too easily. It's precisely the reason that all protections in the legal system need to exist. If you hand-wave away uncertainty about facts, then there's no need to have warrants, reasonable suspicion, right to an attorney, trials, etc.

Re:A Digital Rumor Should Never Lead to a Police Raid by akiselev on Thursday September 22, 2016 @09:07PM (#12561616)
That's kind of his point. Even if you have absolute certainty about the factual accuracy of the tip, it skews law enforcement towards what is essentially discrimination by selective enforcement. Throw in uncertainty due to latent racism in the witness, poor lighting conditions, or a general bias against minorities and you've got the perfect storm for a discriminatory justice system incapable of fairness at all levels.
Re:A Digital Rumor Should Never Lead to a Police Raid by nylsaar on Friday September 23, 2016 @12:02AM (#12562221)
How does having absolute certainty about the factual accuracy of a tip equate to discriminating law enforcement?
Re:A Digital Rumor Should Never Lead to a Police Raid by akiselev on Friday September 23, 2016 @12:32AM (#12562324)
That isn't even remotely close to what I said.