News for hackers. Stuff that matters.
Re:Clinton’s data-driven campaign relied heavily on an algor... by jacques_chester on Thursday November 10, 2016 @08:12PM (#12926465)
You're all going to hear a lot more about the Shy Tory Effect[1] in the coming months and years. It was first identified in Britain. It's talked about in Australian politics too.

In particularly heated elections, right-leaning voters begin to lie to pollsters about their voting intentions. They are embarrassed, or afraid, or skeptical about the pollster's intentions and honesty. So they lie. This creates a misleading impression of the actual position of the candidates.

Typically, exit polls show a much more realistic picture of the vote. It's just that they're too late to operate on.

The next generation of algorithms will need to introduce allowances for the shy tories in the US, relative to the degree to which one side feels unwilling to be honest with pollsters.

[1] https://en.wikipedia.org/wiki/Shy_Tory_Factor

Re:Clinton’s data-driven campaign relied heavily on an algor... by ghostly_s on Thursday November 10, 2016 @08:17PM (#12926495)
My understanding is exit polls are actually pretty unreliable; they are conducted primarily to correlate demographic data with the official totals for future campaigning purposes, but need to be adjusted based on the actual outcome as the raw data is not representative. Perhaps this particular phenomenon is less present, though?
Re:Clinton’s data-driven campaign relied heavily on an algor... by jacques_chester on Thursday November 10, 2016 @08:21PM (#12926518)
My understanding is that they're a better predictor of the final tally than any other poll, because they occur after the vote has been cast.
Re:Clinton’s data-driven campaign relied heavily on an algor... by WillPostForFood on Thursday November 10, 2016 @09:10PM (#12926820)
There definitely have been problems with exit poll accuracy.

http://www.nytimes.com/2014/11/05/upshot/exit-polls-why-they...

Re:Clinton’s data-driven campaign relied heavily on an algor... by jacques_chester on Thursday November 10, 2016 @09:44PM (#12927054)
I think I see the disconnect. I'm Australian, we have compulsory voting. I hadn't connected all the dots on the effects of voluntary voting on exit polls. Only got as far as thinking about the ballot.
Re:Clinton’s data-driven campaign relied heavily on an algor... by zzzcpan on Thursday November 10, 2016 @08:49PM (#12926695)
> In particularly heated elections, right-leaning voters begin to lie to pollsters about their voting intentions. They are embarrassed, or afraid, or skeptical about the pollster's intentions and honesty.

You are in the right direction, but I think it's a bit not like that and not about lying, being afraid and being skeptical about pollster's intention.

If people feel shame for their choice, they would try to avoid expressing it anywhere, participating in polls, etc., especially in front of their peers. In regions where most have opposing views and shame for choosing the other candidate, they will feel pressure to keep their choice to themselves and they won't in the regions where most support the same candidate. Being afraid of something is a completely different thing and generally prevents voters to even vote, not just avoid polls.

Re:Clinton’s data-driven campaign relied heavily on an algor... by jacques_chester on Thursday November 10, 2016 @08:52PM (#12926722)
Britain has voluntary voting too. The phenomenon has been observed in several elections there and in Australia, where voting is compulsory. So discouragement of voter turnout is neither here nor there in the effect.

In the end, it doesn't necessarily matter why it happens.

What matters is that it happens.

Re:Clinton’s data-driven campaign relied heavily on an algor... by zzzcpan on Thursday November 10, 2016 @08:57PM (#12926745)
It does matter why, because scare tactics against voters were used quite often throughout history by dictators.
Re:Clinton’s data-driven campaign relied heavily on an algor... by jacques_chester on Thursday November 10, 2016 @08:58PM (#12926752)
I'm not sure what you're suggesting. Could put it more concretely?
Re:Clinton’s data-driven campaign relied heavily on an algor... by Alex3917 on Thursday November 10, 2016 @08:43PM (#12926663)
The other factor is that the polls were likely rigged in her favor since she was spending so much more on paid advertising. Note how they all magically converged on the last day of the race.
Re:Clinton’s data-driven campaign relied heavily on an algor... by jacques_chester on Thursday November 10, 2016 @08:50PM (#12926704)
> The other factor is that the polls were likely rigged in her favor since she was spending so much more on paid advertising.

I very much doubt this hypothesis, as it requires a large, expensive and perfectly-secret conspiracy.

And for the journalists working in the next room to not want to win a Pulitzer for exposing it.

Re:Clinton’s data-driven campaign relied heavily on an algor... by Alex3917 on Thursday November 10, 2016 @09:26PM (#12926914)
> And for the journalists working in the next room to not want to win a Pulitzer for exposing it.

Has there ever been a case of a journalist winning a pulitzer for uncovering corruption within their own newsroom? I thought there was a de facto ban on that. (E.g. I don't think the NYT won a pulitzer for reporting that they had previously censored all news about Bush's spying infrastructure to help him get re-elected.)

Re:Clinton’s data-driven campaign relied heavily on an algor... by jacques_chester on Thursday November 10, 2016 @09:45PM (#12927065)
> I thought there was a de facto ban on that.

Also ordered by Clinton from a mail-order catalogue, I assume.

Re:Clinton’s data-driven campaign relied heavily on an algor... by Alex3917 on Thursday November 10, 2016 @10:31PM (#12927410)
If the discrepancy is primarily due to the shy tory effect and not the polls being rigged, this should be easy to see from the data because robopolls should be vastly more accurate than live polls. Is this the pattern that actually exists?

edit: "The study found only a slight impact by moving poll respondents from the internet to a phone call with a live interviewer — with larger effects among college-educated white voters."[1][2]

So while I think it's likely there was a shy tory effect, the evidence suggests it was small enough that there must have been other factors at play.

[1] http://www.politico.com/story/2016/11/polling-election-what-...

[2] http://www.politico.com/story/2016/11/poll-shy-voters-trump-...

Re:Clinton’s data-driven campaign relied heavily on an algor... by jacques_chester on Friday November 11, 2016 @07:14AM (#12929935)
> this should be easy to see from the data because robopolls should be vastly more accurate than live polls

The same pattern is observed in other countries regardless of polling method or polling company.

So unless Clinton has been rigging polls world-wide for decades in anticipation of her 2016 run, it seems more plausible that people don't trust pollsters.