News for hackers. Stuff that matters.
Re:Nassim Talebs case against Nate Silver is bad math by Someone1234 on Tuesday April 09, 2019 @05:03PM (#19618907)
It is worth noting that 538 doesn't keep a historical record of their predictions, making it difficult to really see how they predict outcomes coming up to a conclusion. You can only see the latest/final prediction.

538 also predicted lower chances of victory in the weeks and months leading up to that, then adjusted it on election day vanishing away their earlier guesses. This isn't wrong on the face of it, but people infer from the final datapoint to the conclusion later that same day about 538's accuracy.

What I am saying is: 538 needs to keep a historical record of their predictions.

Re:Nassim Talebs case against Nate Silver is bad math by dragonwriter on Tuesday April 09, 2019 @05:22PM (#19619058)
> It is worth noting that 538 doesn't keep a historical record of their predictions, making it difficult to really see how they predict outcomes coming up to a conclusion. You can only see the latest/final prediction.

It's worth noting that you are completely wrong: not only do they keep such a record, they also provide a handy chart of it on the latest prediction page so you can easily see exactly how the prediction changed over time.

Re:Nassim Talebs case against Nate Silver is bad math by Someone1234 on Tuesday April 09, 2019 @09:06PM (#19620729)
Where? Go ahead and link to it.
Re:Nassim Talebs case against Nate Silver is bad math by tweezy on Tuesday April 09, 2019 @09:13PM (#19620779)
Hey I don't have a dog in this fight, but I think this is the link you're looking for.

https://github.com/fivethirtyeight/checking-our-work-data

Re:Nassim Talebs case against Nate Silver is bad math by Someone1234 on Tuesday April 09, 2019 @10:04PM (#19621098)
Nope. I'm looking for 538's predictions. You cannot go from the raw data they used back to how they interpreted it.
Re:Nassim Talebs case against Nate Silver is bad math by wilg on Tuesday April 09, 2019 @10:44PM (#19621336)
Here is the historical data for the 2018 House forecast:

- Web: https://projects.fivethirtyeight.com/2018-midterm-election-f...

- JSON: https://projects.fivethirtyeight.com/2018-midterm-election-f...

You are correct they do not publish the exact math of the forecasts, but you can see how the forecast changed over time.

Re:Nassim Talebs case against Nate Silver is bad math by tweezy on Tuesday April 09, 2019 @10:49PM (#19621364)
The link I provided does actually show every single forecast 538 has ever made. OP was wrong when they said it was the raw data they use to make the predictions. Check out the link I provided, it has everything OP was asking for.
Re:Nassim Talebs case against Nate Silver is bad math by wilg on Friday April 12, 2019 @08:16PM (#19650196)
Nice! I didn’t poke into it much further cause I knew about this one.
Re:Nassim Talebs case against Nate Silver is bad math by tweezy on Tuesday April 09, 2019 @10:35PM (#19621292)
Please look at the actual data on the linked page. Each of the csv files on that page has thousands of predictions 538 made going back as far as 2008. This isn't the raw data they used to make the predictions, these are the actual predications that they made.

Edit: For example, here are the headers on the file named presidential_elections.csv

year,office,state,district,election_date,forecast_date,forecast_type,party,candidate,projected_voteshare,actual_voteshare,probwin,probwin_outcome

These are the actual forecasts they made for presidential elections going all the way back to 2008.

Re:Nassim Talebs case against Nate Silver is bad math by wtallis on Tuesday April 09, 2019 @05:06PM (#19618925)
Re:Nassim Talebs case against Nate Silver is bad math by KC8ZKF on Tuesday April 09, 2019 @05:14PM (#19618982)
The 2016 election predictions are still posted. https://projects.fivethirtyeight.com/2016-election-forecast/...
Re:Nassim Talebs case against Nate Silver is bad math by Someone1234 on Tuesday April 09, 2019 @09:05PM (#19620724)
Yes the newest one. Not the historical ones.
Re:Nassim Talebs case against Nate Silver is bad math by hencq on Tuesday April 09, 2019 @09:26PM (#19620864)
Maybe I misunderstand your argument, but doesn't that linked page have a section "How the forecast has changed"[1]?

[1] https://projects.fivethirtyeight.com/2016-election-forecast/...

Re:Nassim Talebs case against Nate Silver is bad math by dandelany on Tuesday April 09, 2019 @05:11PM (#19618957)
Maybe this was true of past elections, but their 2018 house forecast had a “how this forecast has changed” section that showed their historical predictions throughout election season. It’s still visible here: https://projects.fivethirtyeight.com/2018-midterm-election-f...
Re:Nassim Talebs case against Nate Silver is bad math by dragonwriter on Tuesday April 09, 2019 @05:25PM (#19619087)
> Maybe this was true of past elections, but their 2018 house forecast had a “how this forecast has changed” section that showed their historical predictions throughout election season.

It has not changed. They did this the whole way back when it was an independent blog before the NY Times (later ESPN then ABC News) picked them up.

Re:Nassim Talebs case against Nate Silver is bad math by Someone1234 on Tuesday April 09, 2019 @09:06PM (#19620736)
Where are they? Five different posters have claimed this, but zero have been able to link to the historical predictions.
Re:Nassim Talebs case against Nate Silver is bad math by dragonwriter on Tuesday April 09, 2019 @09:16PM (#19620800)
> Where are they? Five different posters have claimed this, but zero have been able to link to the historical predictions.

They are literally charted on the page with the current prediction, e.g., for the 2016 Presidential race (which is locked on the last forecast):

https://projects.fivethirtyeight.com/2016-election-forecast/ , under “How the forecast has changed”, it charts the forecast (by default, the win probability) for the entire time the race was being forecast.