News for hackers. Stuff that matters.
Re:You cannot police misinformation in a fair, reproducible,... by gilleain on Tuesday February 08, 2022 @02:46PM (#30263556)
Not to distract from your point ... this page : https://en.wikipedia.org/wiki/Historical_polling_for_United_... suggests the value was always between 40-50%

... however I assume you meant "reputable polls", not Polish people :)

Re:You cannot police misinformation in a fair, reproducible,... by lelandfe on Tuesday February 08, 2022 @02:54PM (#30263668)
> the value was always between 40-50%

Those are the raw data from polls (an estimate of the popular vote), not the predictions from them ("who will win" - which is what the original commenter refers to).

Fivethirtyeight had Clinton at 88% less than a month out from election day: https://projects.fivethirtyeight.com/2016-election-forecast/...

Re:You cannot police misinformation in a fair, reproducible,... by quesera on Tuesday February 08, 2022 @03:17PM (#30264008)
> Fivethirtyeight had Clinton at 88% less than a month out

I.e. a couple weeks before James Comey announced a reopening of the investigation into the email issue?

I agree that 538 was likely over-interpreting their data, but I think this is a bad example because the "facts" on the ground changed significantly in the time period.

Re:You cannot police misinformation in a fair, reproducible,... by spywaregorilla on Tuesday February 08, 2022 @03:25PM (#30264115)
I generally put a very high stake of credibility in fivethirty eight. They ended on 71%.
Re:You cannot police misinformation in a fair, reproducible,... by lelandfe on Tuesday February 08, 2022 @03:31PM (#30264201)
> I agree that 538 was likely over-interpreting their data

I did not say this.

I'm illustrating the original poster's comment about these forecasts being guesses of likelihood.

Of course Nate Silver and co. did not have Comey reopening the case as a factor in their models; that is not an indictment of the model itself.

Yet I'm sure all of us knew folks who had opinions riding on the 85%+ forecasts, and then losing faith in the predictions as they wildly changed over the course of weeks.

Re:You cannot police misinformation in a fair, reproducible,... by quesera on Tuesday February 08, 2022 @04:47PM (#30265229)
I missed your point in the original.

As you say, "88% chance of winning" is not "expected to receive 88% of the vote".

The 538 model attempted to weigh the reliability (recency, reputation, magic pixie dust) of polling data and project a range of outcomes.

And even with a "perfect" model, it can take a while to absorb exogenous events like the Comey surprise.

The causes of 538's prediction error might be unknowable. Or, to be fair, if it was even an error! Would we expect probability to approach 100% in the moments before polling opens? Maybe in some fields, but 538 did not attempt this. IIRC they ended at ~70/30 Clinton. A single roll of a die (1d6) will frequently come up 1 or 2.

Re:You cannot police misinformation in a fair, reproducible,... by chmod600 on Tuesday February 08, 2022 @06:45PM (#30266498)
"Of course Nate Silver and co. did not have Comey reopening the case as a factor in their models; that is not an indictment of the model itself."

Why is that not an indictment of the model? Stuff happens in politics. Things change.

A month out you should ordinarily have much less certainty than a day before. But their predictions were the opposite, where certainty was falling. Sure, there can be reasons for that kind of inversion, but usually it's just arrogance and neglecting the long tail of black swans.

Re:You cannot police misinformation in a fair, reproducible,... by zimpenfish on Wednesday February 09, 2022 @05:36AM (#30271142)
> Stuff happens in politics. Things change.

"FBI Director going rogue the week before the election" isn't something you could factor into a prediction because it just hadn't ever happened before. It'd be like trying to factor in "What if an asteroid hits Kansas the week before?"

Re:You cannot police misinformation in a fair, reproducible,... by chmod600 on Friday February 11, 2022 @09:32PM (#30309380)
By itself, that's unlikely. But the point of black swans is not that a particular thing will happen, but that there are zillions of low-probability events and they add up to a high probability.
Re:You cannot police misinformation in a fair, reproducible,... by slg on Tuesday February 08, 2022 @06:21PM (#30266313)
>Fivethirtyeight had Clinton at 88% less than a month out from election day:

It is funny seeing this here because it is a great example of how it is hard to fight misinformation.

What you said is technically correct but it is extremely misleading. There is no reason to use 538's projection a month out from the election when you could be using the one from the day of the election which had Clinton at 71%. You seem to have chosen the moment in which Clinton's odds were the highest to suggest the projection was wrong. Your comment is just as factual as if I said "538 was one of the few outlets that had Trump favored a few months before the election". That would also be technically true but it glosses over the fact that they only had Trump favored on a single day out of the several months they did projections.

Is this "misinformation" meant to smear 538? Is this just run-of-the-mill bias? Is this an honest mistake? It this specific date chosen intentionally and your motive is just being misunderstood? There is no way for a third party to know the definitive answer to these questions, but if I was 538 I would certainly feel a little attacked by your comment and might jump to calling it misinformation.

Re:You cannot police misinformation in a fair, reproducible,... by lelandfe on Tuesday February 08, 2022 @06:44PM (#30266490)
A parent commenter stated projections from reputable outlets were "significantly lower than 99%." Given the original claim of "polls predicted a 99% chance," focusing on a reputable source's highest prediction lends credence to the statement.

That projection was made scant weeks out from the election, as well. It's not irrelevant (Oct. median was 85%), and calling my providing a link misinformation is pretty bizarre.

I suspect this is not the first time you've felt obliged to stick up for 538 but you're purely wielding a strawman in this case. I've expressed no judgement.

Anyway, we're talking about the general populace's sentiments around the predictions. Why would we possibly talk about the predictions made the day of the election – those numbers had done no work in shaping that sentiment.

Re:You cannot police misinformation in a fair, reproducible,... by slg on Tuesday February 08, 2022 @07:21PM (#30266822)
>Given that comment train, wouldn't you focus on the moment they were at their highest? That projection was made scant weeks out from the election, as well.

No, because that 88% was basically a prediction of a prediction because as other people pointed out that occurred before news that changed the makeup of the race. You can't blame them for not knowing the news ahead of time.

It would be like if I predicted the Rams win the Superbowl this weekend, then we find out on Saturday that 10 players will miss the game due to Covid. I might then revise my prediction to the Bengals winning. If the Rams win wouldn't you say my prediction was wrong because of my final prediction? My initial prediction might have been right but that was made with less information and I revised that prediction once I got more information.

Similarly it doesn't make sense to criticize 538 for being less accurate with their early projections when they had less information. As they got more information their predictions became more accurate. It should be obvious that they weren't changing their model in a vacuum to push the odds towards Trump. More information was coming out that improved Trump's odds and the model reflected that.

And to be clear I didn't call your comment misinformation. I used it as an example of why it is hard to categorize misinformation. Some might view your comment as misinformation and some might not. The only value judgement I made was that it is "extremely misleading" and I stand by the categorization regardless of the motive behind your comment.

Re:You cannot police misinformation in a fair, reproducible,... by lelandfe on Tuesday February 08, 2022 @07:25PM (#30266868)
> Similarly it doesn't make sense to criticize 538 for being less accurate with their early projections when they had less information

It must be a good feeling, then, that I have not criticized them.

> to be clear I didn't call your comment misinformation

Earlier:

> Is this "misinformation" meant to smear 538?

Re:You cannot police misinformation in a fair, reproducible,... by slg on Tuesday February 08, 2022 @07:29PM (#30266912)
>It must be a good feeling, then, that I have not criticized them.

You were trying to correct someone who was defending the accuracy of the general industry predictions. If you were not directly criticizing 538, the criticism was certainly implied.

>> Is this "misinformation" meant to smear 538?

Are you familiar with the concept of scare quotes? I specifically used quotes there to indicate that I was not directly calling your comment misinformation but was instead using that term with some detachment.

Re:You cannot police misinformation in a fair, reproducible,... by mbesto on Tuesday February 08, 2022 @03:28PM (#30264156)
> Fivethirtyeight had Clinton at 88% less than a month out from election day

And the way statistics work, a 90% forecast is truly a 90% forecast - they weren't wrong with this. It's just people think 99% chance of winning basically means "they won". But that's not how it works. So the idea that these numbers are misinformation is incorrect, it's that media is using a metric that the average person has trouble comprehending.

Re:You cannot police misinformation in a fair, reproducible,... by double_nan on Tuesday February 08, 2022 @04:54PM (#30265328)
> it's that media is using a metric that the average person has trouble comprehending.

Isn’t that a clear case of disinformation?

Re:You cannot police misinformation in a fair, reproducible,... by mbesto on Tuesday February 08, 2022 @05:36PM (#30265838)
We're talking about metrics with objective definitions that are taught in schools around the country, not headlines like "The President is cancelling his trip to Africa because he hates black people". I don't know, seems like a huge difference to me...
Re:You cannot police misinformation in a fair, reproducible,... by ineedasername on Tuesday February 08, 2022 @06:26PM (#30266348)
No. If the media reports that the average salary is $50k/year that is not disinformation even if a lot of people will misinterpret it as meaning "most people make $50k/year" simply because they don't understand that an average is a measure of central tendency, not distribution.

Something like this only rises to the level of disinformation if the media (or whoever) deliberately presents an accurate piece of data in a way that it knows will not be understood.

If metrics that average people don't understand was disinformation than 90% of my job would be disseminating disinformation. It's not. Instead, a large part of my job is explaining the metrics.

Re:You cannot police misinformation in a fair, reproducible,... by shadowgovt on Tuesday February 08, 2022 @05:10PM (#30265537)
The public being too ignorant to interpret analysis isn't disinformation.
Re:You cannot police misinformation in a fair, reproducible,... by bavell on Tuesday February 08, 2022 @09:38PM (#30268016)
I wish everyone thought this way :/
Re:You cannot police misinformation in a fair, reproducible,... by double_nan on Wednesday February 09, 2022 @12:27AM (#30269208)
So it's ok to mislead people so long as you are not lying directly?
Re:You cannot police misinformation in a fair, reproducible,... by michaelmrose on Wednesday February 09, 2022 @02:47AM (#30270060)
It's ok to pass on accurate information that requires the public to put in the work to accurately understand it.

It is probably impossible to have the complex dialogue sufficient to inform people both intelligent and willing to put in the work in a way that is not apt to either be misunderstood accidentally or more frequently on purpose.

Re:You cannot police misinformation in a fair, reproducible,... by josephh on Tuesday February 08, 2022 @03:01PM (#30263753)
You're comparing apple and oranges. The 99% prediction[1] was based on the statistical significance calculated against the polling results, and was not the actual polling numbers suggested in the wiki that you linked.

1. https://archive.is/enzvh

Re:You cannot police misinformation in a fair, reproducible,... by spywaregorilla on Tuesday February 08, 2022 @02:55PM (#30263680)
Polling numbers are different than predicted chance of winning. A five point difference in polling numbers is likely to be a 90%+ chance of winning.