When a new Earth-crossing asteroid or comet is discovered, it's orbit is rarely known with any great certainty. The cross sectional area of the Earth divided by the area of space the object might possibly pass through yields the chance of a collision. With each successive night of observation, the orbital characteristics are determined to greater accuracy, and the cone of potential trajectories is reduced. As a not-so-intuitive result, the reported probability of a doomsday scenario grows geometrically higher with each successive night of observation. In some cases it makes national or world-wide news as the probability of mass extinction grows from 1 in a billion, to 1 in a million, to one in 10,000... Obviously there's a trend there, right? Some journalists think so, then mass hysteria ensues and NASA receives correspondence from mothers asking if they should euthanize their children to protect them from the horrific event (a true story, sadly).
Then at the height of mass hysteria, the next night's observation brings the circle of uncertainty just small enough to exclude the passage of the Earth, and instantly the probability of Armageddon drops to zero. Those media outlets who hyped the doomsday scenario then accuse the scientists of fear mongering (ironic), and the public forgets until the next big object is found looming our way, and the cycle continues.
It's sad, but not unexpected that the general public lacks the mathematical literacy to understand these statistical quirks. It's truly sad, and perhaps even criminal that journalists, and especially science journalists fall victim to those same misconceptions.
"Journalists"? You are being moderated in your high praise of 'journalists', that is, professional members of the highly professional journalistic profession?
Cruel. SO cruel. How can you be so CRUEL?
I mean, while we're discussing particle physics, don't you believe that the English, drama, theater, and communications majors also need to eat?
And it's even worse, you are being even more cruel: You are suggesting that the journalistic profession should pay attention to technical information and, thus, push out the main technique of journalism back over 100 years: Use communications of human experience and emotion to grab people by the heart, the gut, and below the belt.
So CRUEL!
More concretely, what prior probability would you assign to the distribution of the Higgs mass? This depends on your theory. For instance, supersymmetric theories tend to favor a lower Higgs mass, so if you are a proponent of such theories you wouldn't expect a heavy Higgs anyway.
Note that physicists themselves do not phrase their results in these terms. The statement "Higgs excluded above 130 GeV at 95% confidence" does not mean there is 95% chance the Higgs isn't there. Rather, this statement has a precise meaning based on frequentist reasoning.
But perhaps more importantly, the tone of the article is sensationalist and seems to imply that we are about to give up hope. This isn't true at all. I mean, look:
"while CERN will continue it's search at least until the end of this year, if no positive results about the Higgs should come out, Stephen Hawking ... would be able to cash in on his wager."As you correctly say, the influence that the results we already got about the possibility that Higgs boson exists with a high mass have on the global possibility that there is a Higgs boson depend on the a-priori (to the current experiment) confidence that we give to the high mass/low mass hypotheses. So there is for sure not a 95% drop in confidence, but there is indeed a drop, unless you gave 0 confidence to the high-mass hypothesis before the experiment.
However, as I said above the term "95% confidence" is not related to this reasoning at all. Saying for example "the Higgs mass is not 140 GeV at 95% CL" means precisely: If the Higgs were at 140 GeV, it would have 5% probability of producing the results we measured experimentally. It does not mean "we are 95% sure the Higgs isn't at 140 GeV".
"we should discount our belief that the Higgs has a mass at 140GeV by a factor roughly proportionate to the 95% confidence of the result"
I'm sorry but I don't understand what this means in practice. The first part is a Bayesian belief, while the 95% confidence result comes from frequentist analysis. I'm not sure how you can mix the two."If the Higgs were at 140 GeV, it would have 5% probability of producing the results we measured experimentally" is the same as P(Observation | Higgs at 140Gev) = .05
So we can say that
P(Higgs|Observation) = P(Observation|Higgs) * P(Higgs)
-------------------------------
P(Observation)
So given that getting your new belief about the probability of a Higgs Boson at some energy is going to be updated based on your observation, you can see that it ends up being scaled by that exact confidence result. That's sort of an oversimplification, since really you end up calculating the P(O) scaling factor based on P(O|H) among other things, but I hope you can see how they're closely related in practice.For me the important point to communicate was that the article is, let's say, mostly nonsense. Just consider the title:
> A Higgs Setback: Did Stephen Hawking Just Win the Most Outrageous Bet in Physics History?
Never mind the superlatives. There was no "Higgs setback", and the answer to the question is "No". The article does not leave out the correct details, but I'm quite certain it leaves the layman with the feeling that the Higgs search is all but doomed.
About not using a Bayesian approach, though, I don't understand how could you infer the existence or not of the Higgs without it, considering that we can only measure something that is probabilistically correlated to what we want to find.
In other words, what should happen for you to say that we have verified that there is a Higgs boson? I'm pretty confident that it would be some application of Bayes theorem :)
Finally we're not talking about the probability of some state of the universe in the absolute (as frequentists claim, we can't meaningfully talk about such things), we're talking about some state of the universe given the evidence we have.
The fact that it may take you, say, 90% of the time to search a particular 10% section of a search space doesn't increase the probability of finding the item in that section.
It is easier to discard the ranges that are very far from the mass of the Higgs' boson. So initially the expected range is very broad, something like:
* More than 114GeV, because if it's smaller we would have seen the Higgs boson in another smaller accelerator (LEP)
* Less than 185GeV, because we saw small corrections that are probably due Higgs boson in the (LEP)
So you get a lot of money to build another accelerator, and you are confident that the maximal energy of the collider is enough to see something.
In some ranges, the experiments doesn’t show anything interesting, so it is possible to discard that the mass of the Higgs boson is in that range. It is easier to do this when the range is more far away from the "real" value. So you can discard with a 95% of confidence that range, get some papers published, perhaps a few Ph.D. thesis, compare the data to another more indirect calculations, show some progress, and ask for more money because the accelerator is really big.
The problem is that some energy ranges are more difficult to test, because other well known particles appear but the final results is very similar to what is expected from a Higgs boson. So it is important to choose some strange phenomenon where there is easier to see the difference between a Higgs boson and another particles. So with more experiments you can discard with a 95% of confidence a new range, ..., because the accelerator is really big.
But some ranges are more difficult to discard. There are a lot of interesting phenomenons. Some of them are due to other particles. The other particles are well known, so it is possible to calculate how many of these are expected to appear sadistically. But the experiments show that there are more than expected. It can be a statistical fluke, or it can be corrections that appear because the mass of the Higgs boson is near that range. The real problem is that if the Higgs boson really exists, a lot of corrections appear in the nearby mass ranges, so these ranges are more difficult to discard with a 95% confidence ...
The most difficult range is the one that includes the actual mass of the Higgs boson. It should be impossible to discard :). But it is not enough to not be able to discard it with a 95% confidence, because it can be a statistical fluke. To "prove" that the Higgs boson exists wits a 99.99997% confidence, more and more experiments are necessary to see the difference between a statistical fluke produced by the background process of the other particles and a real signal produced by the Higgs bosons. So you need more time to find it where it really is, than to discard it where it isn’t. (So you need more money to run the accelerator, so you need to dhow some preliminary results.)
So, next year we will probably see something like "RIP^2 Higgs Boson, 99% of the initial search range discarder forever with 95% confidence, only a minuscule 1% remaining." and it will be really a good new. And in a few (5?) years something like "Zombie Higgs Boson found, returned from 99.9% dead." and it will be a really good new.
Maybe the Higgs boson is the new aether[1] which, after many experiments failing at observing its existence, was replaced by relativity and quantum physics. By which I concur that an experiment built for, yet failing to demonstrate a point is not necessarily a failed experiment.
So whatever the results of the LHC, I'm confident that it's a worthwhile task to undertake.
The experiments show that if the Higgs boson exists, it is not very heavy (not heavier than 145GeV). And there is some indirect and inconclusive evidence that it exist and the real mass is near ~120GeV (probably +-10GeV), but it can be a statistical fluke, so we have to wait a few years.
> These assessments carry a probability measure, such as 95%, 99%, or—as traditionally required in particle physics for a “definitive” conclusion about the existence of a new particle: 99.99997% (this is the infamous “five-sigma” requirement).
So...the five-sigma requirement means that your run-of-the-mill physicists won't accept a claim until there's statistical evidence accurate to 99.99997%. From 95% to ...that number is still a significant number of tests, no? Doesn't this paint the title as sensationalist with the author's own words?
This a million times. I want this on a shirt, with the millions of X's and Y's it satisfies. Thank you for posting.
The article's main flaw is its assumption that, because the remaining mass window is "small", it decreases our chances of finding the Higgs. This is not the case for several reasons. Most importantly, it has been known since the planning stages of the accelerator that a Higgs with such a low mass is more difficult to find, in the sense that it requires running the experiment for longer, collecting more statistics, before we can decide whether or not it exists. So it comes as no surprise that we first have conclusive results about the higher mass range. It just happens that the Higgs, if it exists, doesn't have a high mass, so we keep looking.
It is expected that in 1-2 years we will have enough statistics to either discover or rule out the Higgs in the remaining mass window.
The second mistake the article makes is in claiming that not finding the Higgs is somehow a bad thing. That it means the LHC was a waste of taxpayer money. I would say quite the opposite. If the LHC finds the Higgs and nothing else, then it will only confirm our existing model and we will learn nothing new about the world (except for the value of the Higgs mass). This is the worst possible outcome. On the other hand, not finding the Higgs would be an extremely exciting result, since it would open the way to less well-explored ideas about the origin of mass. The goal of the LHC is to teach us about the world, not stroke physicists' egos and tell us how clever our existing theories are.