News for hackers. Stuff that matters.
Re:Court of Appeal bans Bayesian probability by mikeash on Monday February 25, 2013 @09:28AM (#5279077)
"In my opinion statistics alone can never be adequate for conviction."

I'm not sure I understand what you suggest there, because, what else is there?

Let's say a murder conviction is based on 37 different security recordings clearly showing the defendant murdering the victim. The recordings make it a certainty that the defendant is guilty.

But what is "certainty"? It's an expression of probability, and that comes from statistics. Given the evidence, what are the odds that the defendant is not guilty? Extremely low. We have to come up with pretty crazy alternatives. The probability of the defendant being innocent in this case might be, let's say, 1 in 10^20.

We don't need to actually carry out this calculation, because we don't need the precise probability. It's clear that the probability is extremely low, so we can take a shortcut and refrain from figuring out exactly how low. But that shortcut is still ultimately an exercise in statistics.

Re:Court of Appeal bans Bayesian probability by scott_w on Monday February 25, 2013 @09:44AM (#5279145)
You've completely missed the point.

Having something on a security recording can be classed as "hard evidence".

The case in question was one of using circumstantial evidence alone to "statistically" decide whether she was guilty or not.

The law differentiates between circumstantial evidence and hard evidence. People aren't supposed to be convicted on circumstantial evidence alone.

Re:Court of Appeal bans Bayesian probability by ScottBurson on Monday February 25, 2013 @11:30AM (#5279730)
People aren't supposed to be convicted on circumstantial evidence alone.

IANAL but I think this is very wrong.

Obviously the court will prefer strong forensic evidence if it can get it. But when it isn't, defendants can be, and are, convicted on circumstantial evidence, and this is not considered a miscarriage of justice.

If a security recording captures someone whose face can be clearly seen to be that of the defendant, and the recording shows them actually committing the crime, okay, that's pretty hard evidence. Anything short of that -- their face isn't shown clearly, perhaps, or the recording shows them being in the area but doesn't prove they actually committed the crime -- and you start having to talk about probabilities.

Even forensic evidence comes with probabilities attached. It's routine for fingerprint and DNA matches to be qualified with a probability of error. And often the true accuracy is overstated.

Re:Court of Appeal bans Bayesian probability by mikeash on Monday February 25, 2013 @10:06AM (#5279242)
What differentiates hard evidence from circumstantial evidence? It comes down to the probabilities, which in turn comes down to statistics.
Re:Court of Appeal bans Bayesian probability by damoncali on Monday February 25, 2013 @10:27AM (#5279345)
Assumptions. The devil is in the details. Throw too much math with too many assumptions at anyone but a panel of PhD's and you will get all kinds of misinterpretation, misunderstanding, and just plain wrongheadedness.
Re:Court of Appeal bans Bayesian probability by mikeash on Monday February 25, 2013 @01:58PM (#5280887)
Certainly. My point is that, even if you don't want to discuss it, or use it, it all comes down to statistics and probability in the end. Get the most extreme proof you can imagine for somebody's guilt and that extreme certainty still comes down to probability in the end.
Re:Court of Appeal bans Bayesian probability by gamblor956 on Monday February 25, 2013 @06:08PM (#5282517)
Noncircumstantial evidence is evidence which directly supports the point for which it is introduced, without any inference required.

Circumstantial evidence is evidence which requires a logical inference in order to support the point for which it is introduced.

That is roughly how evidence is explained by judges to juries in courtrooms.

For example, the victim's blood on the defendant's shoe is noncircumstantial evidence because it directly supports the point that the defendant was present in the vicinity of the victim's body. However, finding at the crime scene a brown fiber which is same type of fiber used to stich the defendant's very expensive, limited edition gloves, would be circumstantial evidence because you have to logically infer that the fiber found comes from the defendant's gloves. Alternatively, finding gloves that are identical to the defendant's gloves is also circumstantial evidence unless there is other evidence showing conclusively that those particular gloves are the defendants, i.e., footage of the defendant leaving the gloves there or something.

Re:Court of Appeal bans Bayesian probability by psb217 on Monday February 25, 2013 @07:05PM (#5282829)
Your choice of examples actually supports the statistical nature of the distinction between circumstantial and noncircumstantial evidence. That the blood on the defendant's shoe came from the victim's body is based on a probabilistic test. That the blood on the defendant's shoe arrived through physical co-presence of the shoe and the blood's source body (whether or not it was the victim's) is also only "hard" evidence in the sense that other explanations are relatively improbable.

The difference between the probabilities involved in the above inferences, and the analogous inferences ineluctably underlying any hard evidence, and those involved in circumstantial evidence like your coat fiber, are purely quantitative. In some sense, hard evidence is that which can be accepted "beyond a reasonable doubt", while circumstantial evidence is that which does not pass such a test.

Unfortunately, "beyond a reasonable doubt" escapes precise definition. Yet, courts need to function, so we tacitly agree that sufficiently large quantitative differences are (legally) indistinguishable from qualitative differences.

(EDIT: I'm saying the same thing as mikeash, whose response appeared while I was writing my own)

Re:Court of Appeal bans Bayesian probability by gamblor956 on Tuesday February 26, 2013 @01:36PM (#5287443)
You guys still aren't getting it; circumstantial evidence is not about the probability that the evidence is what it claims to be, it is about the necessary inference about what the evidence proves if the evidence is what it claims to be.

Noncircumstantial evidence directly supports the point for which it is introduced if the evidence is what it claims to be. The victim's blood on the defendant's shoe directly supports the point that the defendant was in the victim's presence when the victim was dying if it is established that the blood is the victim's blood.

Circumstantial evidence requires an additional inference beyond this step. The fibers are circumstantial because the fiber doesn't prove anything except that the someone wearing those gloves might have been at the crime scene at some point in time. You require the additional inference that the fiber was left at the scene at the time of the crime, which the fiber by itself does not prove but which can be "circumstantially" proved in combination with other evidence. For example, if the defendant, or some other witness, claims that the defendant was never at the scene of the crime at any point in time (specifically, but not limited to, periods prior to the crime), the presence of the rare fibers from his rare gloves is circumstantial evidence that the only time he was at the scene of the crime was when the crime occurred. In other words, the circumstances surrounding the fiber are the proof, not the fiber itself.

Re:Court of Appeal bans Bayesian probability by psb217 on Thursday February 28, 2013 @07:32PM (#5302051)
Your second paragraph ignores the inference required to go from victim's blood on defendant's shoe to defendant's shoe was in physical proximity to victim's body. It also ignores the inference required to go from blood is measured as matching victim's to blood came from victim's body. It also ignores the inference required to go from blood was deposited onto defendant's shoe directly by victim's body to defendant was wearing shoe at time of blood deposit and thus in presence of victim's still-bleeding corpse.

The (admittedly pedantic) point being made is that proving 'x' never directly supports anything other than the truth of 'x'. Moving from 'x' is true to 'y' is true always requires further inference.

Re:Court of Appeal bans Bayesian probability by mikeash on Monday February 25, 2013 @06:48PM (#5282735)
It all requires inference, though. The legal system just pretends that some inference comes "for free", and some doesn't. You never have "the victim's blood on the defendant's shoe", you have blood which you have reason to believe belongs to the victim on shoes you have reason to believe belong to the defendant. The only actual difference between your two examples is that of degree, i.e. the evidence linking the blood to the victim is much stronger than the evidence linking the fiber to the defendant.
Re:Court of Appeal bans Bayesian probability by Dylan16807 on Monday February 25, 2013 @06:53PM (#5282752)
What about when the defense agrees that it is in fact the victim's blood? Many things in a trial are stipulated to be true.
Re:Court of Appeal bans Bayesian probability by dllthomas on Monday February 25, 2013 @08:15PM (#5283193)
Interesting question, but doesn't quite seem to be the difference between hard and circumstantial evidence.
Re:Court of Appeal bans Bayesian probability by Dylan16807 on Monday February 25, 2013 @09:39PM (#5283557)
Not by itself, but if you use it to discount negligible uncertainty then you can use it as a method to reach 'direct' aka non-circumstantial evidence.
Re:Court of Appeal bans Bayesian probability by dllthomas on Monday February 25, 2013 @11:57PM (#5284072)
I don't know. It seems like the defense can stipulate things that are nonetheless circumstantial evidence. Like, if the defendant acknowledges being in the area at the time, the prosecution no longer needs to deal much with evidence that establishes that, but that's still not "direct evidence" of the crime.

However, the main point of this thread of discussion I think was that even things that legally are considered "direct evidence" - say, testimony of an witness to the crime - do nonetheless involve some inference...

Re:Court of Appeal bans Bayesian probability by Dylan16807 on Monday February 25, 2013 @10:30AM (#5279358)
No it doesn't. A blurry possibly-faked nigh-useless photo is still hard evidence.
Re:Court of Appeal bans Bayesian probability by reader5000 on Monday February 25, 2013 @01:15PM (#5280486)
The value of which is statistical.
Re:Court of Appeal bans Bayesian probability by mikeash on Monday February 25, 2013 @01:47PM (#5280798)
What separates hard evidence from circumstantial evidence, then?
Re:Court of Appeal bans Bayesian probability by Dylan16807 on Monday February 25, 2013 @06:49PM (#5282740)
I probably should have specified a photo of the crime.

Circumstantial evidence is indirect, like you being in the area of something, hard evidence is actually of you committing an alleged act.

Re:Court of Appeal bans Bayesian probability by vagarwa on Monday February 25, 2013 @02:02PM (#5280918)
a really good lawyer (aka, lots of money).
Re:Court of Appeal bans Bayesian probability by jarrett on Monday February 25, 2013 @01:03PM (#5280398)
Having something on a security recording can be classed as "hard evidence".

The case in question was one of using circumstantial evidence alone to "statistically" decide whether she was guilty or not.

And yet, aren't all types of hard evidence really just probabilistic as well? For example, there is a non-zero probability that the murderer on the security camera is merely a person with an amazing physical similarity to the defendant. If we could develop an accurate mathematical model of human physical features, we could even estimate the probability that we're looking at a double and not the defendant.

Likewise, when a DNA match is used in court, the forensic scientist typically testifies to the probability of a false match. Once again, the evidence is probabilistic.

In both of these cases, the probability of a mistake is low. But it is non-zero, and it can be quanitified--if not with current technology, then at least in principle.

So, you will never get away from deciding cases probabilistically. And if you simply refuse to assign numerical probabilities to anything even when the circumstances readily permit it, you're not increasing your chance of being right, you're just sticking your head in the sand.

Re:Court of Appeal bans Bayesian probability by AnthonyMouse on Monday February 25, 2013 @12:10PM (#5280034)
>Let's say a murder conviction is based on 37 different security recordings clearly showing the defendant murdering the victim. The recordings make it a certainty that the defendant is guilty.

This is the problem with this approach. Let's say the guilty party is someone who looks like the defendant. Now it doesn't matter how many security cameras there are, they all record what happened: Someone who looks like the defendant commits a murder on camera. The number of recordings doesn't inherently show whether it was the defendant or a double.

Or let's suppose that the evidence has been fabricated by someone trying to frame the defendant. Someone who fabricates one recording to the satisfaction of the jury can generally fabricate 37.

Or perhaps it was the defendant on the video but it wasn't a murder, it was a staged public death in cooperation with the alleged victim who subsequently went into hiding.

All of these things are individually relatively unlikely, but they don't become any more unlikely as a result of additional recordings.

This is one of the reasons why conviction rates are generally so high. Suppose (picking a number out of a hat, since we can't really know) that 60% of the accused who go to trial are actually guilty as a factual matter. But of the ones who aren't guilty, 0.6% are because a double committed the crime, 0.5% are cases where the defendant is being framed by a third party or the police, 0.7% are cases where the defendant could show a lack of guilt but doing so would endanger someone else and the defendant prefers to risk prison over endangering that person, etc., and when you add up all the individually low probabilities it turns out that at least one of them has happened in a quite substantial percentage of cases.

The trouble is that the defendant who goes to trial and claims to have been framed is not believed, because only 0.5% of cases are genuine instances of framed defendants (and juries intuitively understand that), and the prosecutor is too often allowed to infer from this that the remaining 99.5% of defendants are actually guilty, rather than that some quite large percentage of them are not guilty but for some other reasons, each of which seems about equally unlikely in any given case and is thus subject to the same misleading inference. But the alternative, to rigorously consider each of the individually not very likely alternatives, is extraordinarily expensive -- which is why statistics is given the short shrift.

At the end of the day the problem is that proving guilt to a level of certainty that would satisfy us if we were being rigorous about it would also cost too much and be too difficult for prosecutors to prove in most cases to satisfy our political desire to incarcerate "bad people" on a mass scale without breaking the bank any more than we already do. Rigorous, large scale, feasible budget. Pick two.

Re:Court of Appeal bans Bayesian probability by duaneb on Monday February 25, 2013 @12:13PM (#5280049)
Statistically means it's just an inductive argument for guilt, but so is being caught on camera. So I suspect that you just don't mean to use statistical at all.

The fact is there's no hard line between good and bad evidence, though I sincerely hope Bayesian equations are never the deciding factor in court cases. Math is great, but "probably guilty" just isn't good enough unless it's incredibly probable. As in, 99% probability seems to be a near certainty, but 75%? 75% is still a strong induction, but that's a 1/4 chance you're convicting an innocent person. So where do you draw the line?

Also remember that Bayesian Probability is still susceptible to bias extremely easy just by determination of how to define the variables. If I were looking to convince a jury, it would be fairly easy to tweak the variables and have a large degree of control over the resulting probability while appearing unbiased (because of Math!). So in this sense, I think that bayesian probability is pseudomathematics. Nobody's questioning the math, but the conclusions are not purely derived from math.

Re:Court of Appeal bans Bayesian probability by mikeash on Monday February 25, 2013 @01:56PM (#5280878)
"Statistically means it's just an inductive argument for guilt, but so is being caught on camera. So I suspect that you just don't mean to use statistical at all."

I don't understand what you're saying. The fact that being caught on camera is an inductive argument for guilt is ultimately based on statistics or probability. What is the probability that the person on camera is the defendant?

Where do you draw the line? The American legal system, for criminal cases, draws it at "beyond a reasonable doubt", and provides no numerical guidance for what that means. But there is a line, and not wanting there to be one doesn't make it go away.