News for hackers. Stuff that matters.
Re:The New York Times Is Eliminating Its Public Editor Role by joshuamorton on Thursday June 01, 2017 @11:30AM (#14461106)
Polling data wasn't even wrong. It was almost spot on in measuring popular vote totals. The mistakes were solely with some state level polls (and really not even mistakes, just high uncertainties) and poll aggregators.

Really, I think most of the incorrect predictions came from one error: assuming a higher level of independence between state results than is actually the case. Nate Silver/538 talk about this some, and they gave Trump the highest (~30%) chance of winning on election day.

Re:The New York Times Is Eliminating Its Public Editor Role by tmaly on Thursday June 01, 2017 @12:01PM (#14461441)
Polling can be incredibly hard. If you ask the wrong type of questions you introduce a bias. If you ask the wrong types of people you have sampling error.

All of these things could have occurred, but something definitely was wrong with the polling data. Nate Silver just like NYT gave Hillary a 90% chance at the start of the day, and this was all based on using the polling data as inputs to their models.

Re:The New York Times Is Eliminating Its Public Editor Role by joshuamorton on Thursday June 01, 2017 @12:33PM (#14461790)
>Nate Silver just like NYT gave Hillary a 90% chance at the start of the day

He didn't though, and that's my point. What you're saying is factually untrue, they haven't updated their prediction since election morning, and it sits at 71% Clinton [0] (Updated Nov. 8, 2016). If you don't believe that, then you can take a look at archive.is, which provides timestampped copies. This [4] is an archived copy from well before polls closed (3:30 PM), there are others from earlier in the day.

I don't know what led you to believe that it was a sure clinton win, but that just wasn't the case.

Clinton won the popular vote by somewhere between 2 and 3%. National polls from just before the election (also per 538, [1]):

    +4, +2, +3, +4, +4, +4, +4, +4, +2, +3
An arithmetic average of those gives C + 3.4.

Take Florida, a state trump won, here's polls taken in Novemeber [2]:

    +1, -3, +0, +2, +1, -4
An arithmetic mean gives -.5, Trump won by about a percent.

Take Pennsylvania [3], another close state. November polls again

    +1, +2, +4, +6, +3, -2, -2, +0, +0, +2, +2

An arithmetic mean gives Clinton + 1.18, Trump won by about .7, so this was perhaps the greatest polling blunder, and its still a margin of under 2%, which isn't unheard of.

[0]: https://projects.fivethirtyeight.com/2016-election-forecast/ [1]: https://projects.fivethirtyeight.com/2016-election-forecast/... [2]: https://projects.fivethirtyeight.com/2016-election-forecast/... [3]: https://www.nytimes.com/elections/results/pennsylvania [4]: https://archive.fo/4EQGB

Re:The New York Times Is Eliminating Its Public Editor Role by tmaly on Friday June 02, 2017 @12:26PM (#14471121)
I stand corrected, it was 71.4% The 90% from NYT stood out in my mind.