News for hackers. Stuff that matters.
Re:EU Referendum Results by hencq on Thursday June 23, 2016 @08:33PM (#11965373)
The University of East Anglia have a live blog as well that updates their predictions based on statistical model [0] by Dr Chris Hanretty. Predictions are based on how results differ from the prior model. The model is explained in more detail here [1].

[0] http://www.ueapolitics.org/2016/06/23/eu-referendum-allnight...

[1] http://www.ueapolitics.org/2016/06/09/the-eu-referendum-what...

Edit: They moved their blog to Medium because of the demand: https://medium.com/@chrishanretty/eu-referendum-rolling-fore...

Re:EU Referendum Results by joosters on Thursday June 23, 2016 @09:48PM (#11965702)
Live betting from Betfair's betting exchange / prediction market:

https://www.betfair.com/exchange/plus/#/politics/market/1.11...

Interesting because the odds react far quicker than any live blog I've found, so a sudden swing means that there's just been a surprising result announced.

Re:EU Referendum Results by fefifofu on Thursday June 23, 2016 @11:07PM (#11966005)
The foreign exchange market has more volume and eyes watching it. Just watch the value of the GBP.
Re:EU Referendum Results by dzdt on Thursday June 23, 2016 @10:04PM (#11965755)
What is the formula to translate from betfair's back/lay for exit/remain to percent likelihood of each outcome?
Re:EU Referendum Results by selectron on Thursday June 23, 2016 @10:08PM (#11965767)
This site does the calculation: https://electionbettingodds.com/brexit.html
Re:EU Referendum Results by joosters on Thursday June 23, 2016 @10:29PM (#11965830)
Implied probability is 100 / odds
Re:EU Referendum Results by BurningFrog on Thursday June 23, 2016 @10:50PM (#11965930)
If the odds are 4:1, I'm not sure what that means.

100/4:1 is a notation mystery. 25%?

Re:EU Referendum Results by danbruc on Thursday June 23, 2016 @11:04PM (#11965991)
x:y or x/y means y / (x + y), so 4:1 is 1 / (4 + 1) or 20 %.
Re:EU Referendum Results by dzdt on Thursday June 23, 2016 @11:12PM (#11966027)
But what do "back" and "lay" mean?
Re:EU Referendum Results by corin_ on Thursday June 23, 2016 @11:15PM (#11966051)
Backing is betting on it to happen, laying is being the bookie for somebody else (i.e. betting against it happening).

So if something is 4/1 and you back it, you'll win £4 for each £1 you wager. If you lay it, you'll win £1 for each £4 wagered.

Betfair exchange is matching up people on both sides of the bet, with a margin of commission in between the back and lay values.

Re:EU Referendum Results by danbruc on Thursday June 23, 2016 @11:14PM (#11966043)
Back means you bet on something happening, lay means you bet against it happening.
Re:EU Referendum Results by danielvf on Thursday June 23, 2016 @10:24PM (#11965810)
You can go to the graph on betfair and "invert axis" to see the actual probability.
Re:EU Referendum Results by AReallyGoodName on Thursday June 23, 2016 @10:43PM (#11965897)
Now well over 4:1 for remain. The change in betting ods is extremely interesting from a statistical modelling point of view.

http://www.oddschecker.com/politics/british-politics/eu-refe...

I don't care about the result. I'm more interested in how our statistical modelling tools failed us. Thoughts? Did opinions change overnight? Did the polling miss a demographic?

Re:EU Referendum Results by fdsaaf on Thursday June 23, 2016 @10:46PM (#11965914)
Bradley effect: https://en.wikipedia.org/wiki/Bradley_effect

(Also known as social desirability bias)

Lots of people say in public that they're in favor of immigration, unity, and tolerance, because lots of people will call you a bigot if you don't, but in private, harbor old-fashioned ideas about nationalism, and well, polling involves a human and voting happens in private.

Re:EU Referendum Results by evanpw on Thursday June 23, 2016 @11:16PM (#11966052)
Makes me wonder about the Trump presidential odds: https://electionbettingodds.com/. They're not even as wide as the Brexit odds were earlier today.
Re:EU Referendum Results by fdsaaf on Thursday June 23, 2016 @11:20PM (#11966066)
Well, since we have much more information about presidential elections (which happen regularly) than we have about brexit (which is mostly without precedent), you could argue that election 2016 forecasts are probably more accurate.

I don't think that's the case though. I predict a Trump victory on the basis of a very strong social desirability bias and an immense amount of silent resentment against current social justice orthodoxy, especially as it pertains to speech restrictions on campus and in the workplace.

Re:EU Referendum Results by toyg on Thursday June 23, 2016 @11:48PM (#11966164)
Yup. I got some money on Trump too, and tbh I was tempted to double-down on it now that we know he's facing a 100% "establishment" "PC" candidate.

I've gone through Italian politics in the '90s. We tend to be pioneers when it comes to political monstrosities.

Re:EU Referendum Results by chroma on Thursday June 23, 2016 @11:52PM (#11966183)
Just curious, but have you acted upon this belief and bet on Trump in the prediction markets?
Re:EU Referendum Results by fdsaaf on Thursday June 23, 2016 @11:56PM (#11966212)
I don't have that much confidence in my analysis. I'm an amateur.
Re:EU Referendum Results by evanpw on Thursday June 23, 2016 @10:52PM (#11965947)
But if this is a known effect, why were the betting markets also wrong?
Re:EU Referendum Results by selectron on Thursday June 23, 2016 @11:08PM (#11966009)
The betting markets had somewhere around a 35% of Brexit. So it wasn't that unlikely according to the betting markets.
Re:EU Referendum Results by evanpw on Thursday June 23, 2016 @11:14PM (#11966044)
I saw 15% before election data started coming out. That's pretty wrong.
Re:EU Referendum Results by selectron on Thursday June 23, 2016 @11:44PM (#11966140)
It looks like the average was around 35%: http://predictwise.com/politics/uk-politics Interestingly the odds went down pretty sharply as the election came closer, but it is not really fair to pick the lowest odds when evaluating how good the predictions were. But even 15% odds are not really all that unlikely, about a 1 in 6 chance. It isn't as though pundits were predicting leave.
Re:EU Referendum Results by fdsaaf on Thursday June 23, 2016 @10:55PM (#11965963)
I think betting markets are prone to wishful thinking; there's no guarantee that errors of reasoning toward one side or the other will cancel out, since it's perfectly reasonable to imagine that errors in one direction are more common.
Re:EU Referendum Results by maxerickson on Thursday June 23, 2016 @11:09PM (#11966012)
There's no guarantee, but the bookie is watching his, uh, book and adjusting the odds to make sure the payouts come from losing bets rather than his pocket.
Re:EU Referendum Results by Lxr on Friday June 24, 2016 @12:07AM (#11966276)
Not on Betfair, it's an exchange. They make money either way.
Re:EU Referendum Results by Callmenorm on Thursday June 23, 2016 @11:11PM (#11966021)
Or maybe people are using the betting markets to hedge. Is that a dumb thing to do?
Re:EU Referendum Results by evanpw on Thursday June 23, 2016 @11:14PM (#11966040)
I think that hedging would have the opposite effect. The pound is tanking (30-year low right now), so if your salary is paid in pounds, it would have made sense to bet on Leave. I'm not sure who wins economically from leaving. British companies that compete with continental ones?
Re:EU Referendum Results by notahacker on Friday June 24, 2016 @12:18AM (#11966363)
Pollsters were never confident of this result, with their adjusted and unadjusted results being all over the place, and were cautiously predicting Leave victories as recently as last week. There weren't any relevant precedents for them to test their models against, and the biggest factor in the Leave vote appears to be high turnout from demographics that rarely vote in other elections.

I've found it odd that the markets were far more confident in poll findings than the pollsters but assume that the bets were mainly placed on the simple heuristic that poll results tend to understate voters caution and attachment to the status quo.

Re:EU Referendum Results by jsprogrammer on Thursday June 23, 2016 @09:58PM (#11965735)
Or, someone made a large transaction.
Re:EU Referendum Results by jessaustin on Thursday June 23, 2016 @10:07PM (#11965763)
More likely that many people made bets, which they'll do when, as parent had it, "there's just been a surprising result announced."
Re:EU Referendum Results by bbcbasic on Thursday June 23, 2016 @09:57PM (#11965733)
Given that there will be a number of swings maybe a good strategy is to bet on the one with longer odds, wait till the next swing, sell and buy the other, rinse and repeat.

Profit!

Re:EU Referendum Results by joosters on Thursday June 23, 2016 @10:05PM (#11965758)
Odds on 'remain' have already oscillated in the last few hours from 1/16 to 2/1 (94% to 33% implied probability)
Re:EU Referendum Results by bbcbasic on Thursday June 23, 2016 @10:19PM (#11965792)
I saw that reverse for a few minutes on Betfair. It's a fairly illiquid market looking at the depths.
Re:EU Referendum Results by joosters on Thursday June 23, 2016 @10:31PM (#11965839)
About £100 million has the traded on that market, that's far from illiquid.
Re:EU Referendum Results by cperciva on Thursday June 23, 2016 @08:40PM (#11965398)
In case those links continue to have database problems, you can also read Chris Hanretty's updates via twitter: https://twitter.com/chrishanretty
Re:EU Referendum Results by excalibur on Thursday June 23, 2016 @10:07PM (#11965762)
He's called it. According to this model there's a 100% cance of leaving.
Re:EU Referendum Results by jboydyhacker on Thursday June 23, 2016 @09:29PM (#11965623)
His latest update seems crazy- p at .03 based on that data seems like an unlikely jump based on the changes in votes and % reporting from each update.

Seems bogus.

Re:EU Referendum Results by jonas21 on Thursday June 23, 2016 @09:37PM (#11965653)
Why does the drop from p=0.32 to p=0.03 seem crazy/bogus? Isn't that what you'd expect as the probability distribution both narrows (with more evidence) and moves toward the 'leave' side?
Re:EU Referendum Results by excalibur on Thursday June 23, 2016 @09:41PM (#11965667)
It's a big jump in a single update. Given that Remain has since pulled ahead in the raw total, this only makes it appear more questionable.
Re:EU Referendum Results by hencq on Thursday June 23, 2016 @09:46PM (#11965690)
That Remain pulled ahead is somewhat irrelevant though. That seems to be mostly due to London reporting in, which was always expected to vote Remain. What's relevant (for this model at least) is whether the results are higher or lower than predicted per area.
Re:EU Referendum Results by EGreg on Thursday June 23, 2016 @10:40PM (#11965874)
And now Leave is ahead again
Re:EU Referendum Results by voyou on Thursday June 23, 2016 @09:56PM (#11965730)
If the model is being updated based on results as they come in, and the results coming in are not randomly distributed, then the updates will be of questionable value. In particular, this update came when a large number of predicted pro-leave results had come in, and no results from predicted strong pro-remain results had come in, so I'm not sure it has much value as a prediction.
Re:EU Referendum Results by notahacker on Thursday June 23, 2016 @10:09PM (#11965771)
Interesting he's since increased the certainty of a Leave vote even after a couple of unexpectedly strong pro-Remain votes swung the betting markets back in favour of Remain

Whether that's because he's better than the markets at modelling differential turnout or the markets know things his confirmed results data doesn't about predicted results in places like Birmingham remains to be seen...

Re:EU Referendum Results by Reason077 on Thursday June 23, 2016 @10:16PM (#11965786)
As I understand it, the model is based on the difference between expected and actual results in each area. So the order that results come in should not affect the prediction.
Re:EU Referendum Results by _delirium on Thursday June 23, 2016 @11:13PM (#11966037)
> So the order that results come in should not affect the prediction.

This model uses a frequentist prediction interval, which assumes independently drawn samples, meaning reporting order must be random for the assumptions to be valid. If reporting is non-random, e.g. how early or late a district reports is correlated with things like region, demographics, population density, etc., then the prediction interval is probably narrower than it should be, especially early on in the reporting (meaning the model is overconfident in its prediction).

The headline prediction is more robust if you just want to know which outcome is more likely given current results, but the probabilities being badly calibrated due to these kinds of model assumptions is a common issue in quantitative polisci models.

Re:EU Referendum Results by cperciva on Thursday June 23, 2016 @09:31PM (#11965633)
That was P = 0.03, or 3%. Not 0.03%.
Re:EU Referendum Results by dbcooper on Thursday June 23, 2016 @09:31PM (#11965632)
Yup! He did qualify his prediction though:

https://medium.com/@chrishanretty/eu-referendum-rolling-fore...

>This is a big update, and I'm conscious that I may have made a terrible mistake somewhere in estimating differential turnout, but here goes:

Re:EU Referendum Results by tomp on Thursday June 23, 2016 @09:32PM (#11965635)
That update might be a bit dated... Glasgow just reported, heavily in favor of Bremain, tipping the scale of the current vote count.
Re:EU Referendum Results by redwood on Thursday June 23, 2016 @09:43PM (#11965677)
The totals will go back and forth, but it's all about turnout proportionally in in- vs out- regions versus original projections. Glasgow was expected to be massively pro-remain but did Glasgow turn out in higher/lower numbers than anticipated? and did Glasgow go more or less pro-remain than anticipated? I would be very very worried if I were a British citizen in the remain camp right now.
Re:EU Referendum Results by cdash on Thursday June 23, 2016 @09:44PM (#11965681)
Depends on how Glasgow was predicted to vote in their model. If it matches their prediction then the impact would be limited.
Re:EU Referendum Results by wanda on Thursday June 23, 2016 @08:40PM (#11965405)
Re:EU Referendum Results by excalibur on Thursday June 23, 2016 @09:18PM (#11965569)
That last update took the chances of leaving from 68% to 97%. Looks like a mistake to me.
Re:EU Referendum Results by danieltillett on Thursday June 23, 2016 @09:21PM (#11965591)
Why? Of course the model might be making a wrong prediction, but if I had a betting account betting on leave looks very tempting.
Re:EU Referendum Results by ubernostrum on Thursday June 23, 2016 @10:50PM (#11965936)
Maybe be glad you don't have a betting account. I wouldn't trust anyone who thinks they can model this to the point of literally attaching "p=1.0", this early on.
Re:EU Referendum Results by danieltillett on Thursday June 23, 2016 @11:06PM (#11966001)
I am not much of a gambler, but with a spread like this it looks very tempting. The currency market boys seem to think out has won.

Anyway using my imaginary betting account I will bet a million pounds - I will enjoy the cup of imaginary coffee I will be able to buy with my winnings :)

Re:EU Referendum Results by eru on Thursday June 23, 2016 @11:38PM (#11966118)
You expect a lot of imaginary GBP inflation?
Re:EU Referendum Results by danieltillett on Friday June 24, 2016 @12:10AM (#11966306)
No I live in Australia so I have to covert my imaginary winnings pounds into imaginary Australian dollars to be able to buy my imaginary coffee ;)

More seriously the model was right and the bookies wrong - it is relatively rare that you get an opportunity like this handed to you to make money with almost no risk.

Re:EU Referendum Results by ubernostrum on Friday June 24, 2016 @12:39AM (#11966528)
make money with almost no risk

I still think p=1.0 was not possibly achievable via any model at that point in the counting, which means betting based on it would have been an enormous risk. The fact that the bet would have paid off makes no difference; especially given how close the vote seems to have gone, a coin flip would have gotten it right half the time, and I doubt you'd say that a coin flipper who just declares 100% confidence has a good model.

Re:EU Referendum Results by danieltillett on Friday June 24, 2016 @01:00AM (#11966672)
The model was almost exactly spot on, while the bookies were still offering 6/4 on for remain at the time I originally posted. The betting market really was not adjusting to the changing data and was way off on the real odds - this is quite rare.

I certainly hope that the people who made money off Chris’ model follow his suggestion and donate to the Jo Cox fund.

Re:EU Referendum Results by eru on Friday June 24, 2016 @01:39AM (#11966893)
The odds were advertised---but were they actually still accepting bids at these odds?
Re:EU Referendum Results by danieltillett on Friday June 24, 2016 @02:41AM (#11967224)
I don’t know - they certainly were in my imaginary account :)