News for hackers. Stuff that matters.
Re:A ragtag band of internet friends became the best at fore... by danielmarkbruce on Tuesday March 12, 2024 @08:34PM (#39686642)
You don't know for that event.

If you predict 100s of events, then use a method like Brier scores, you can get a good idea of how good you are. Even then it's probabilistic, but with enough samples it becomes incredibly unlikely you are just the worlds luckiest guesser.

Re:A ragtag band of internet friends became the best at fore... by dotancohen on Wednesday March 13, 2024 @02:24AM (#39688583)

  > it becomes incredibly unlikely you are just the worlds luckiest guesser
And yet that is still more likely than the idea that you can predict the future.

In any case, we are not talking about _you_ becoming the world's best guesser, we are talking about _somebody_ becoming the world's best guesser. That is going to be someone, so no need to be surprised when they emerge.

Re:A ragtag band of internet friends became the best at fore... by omeze on Wednesday March 13, 2024 @02:51AM (#39688693)
you're right, but people predict the future all the time, if there's a pre-established model for that prediction. I just threw a ball in the air and predicted how long it'd stay there </akshually>

so I think this comes down to how the predictions were arrived. One way to do this is to ask individuals who both have similarly high predictive scores and bet on the same types of events to explain some of their past predictions, and if their methods are similar then you've learned a new predictive tool.

Re:A ragtag band of internet friends became the best at fore... by valval on Wednesday March 13, 2024 @06:46AM (#39689951)
How is the difficulty of a certain prediction scored and weighted?
Re:A ragtag band of internet friends became the best at fore... by danielmarkbruce on Wednesday March 13, 2024 @10:54AM (#39691939)
In these competitions it generally isn't. So, you can't compare, for example, my brier scores for predicting events a, b, c and yours for events x, y, z.
Re:A ragtag band of internet friends became the best at fore... by danielmarkbruce on Wednesday March 13, 2024 @10:45AM (#39691830)
There aren't actually that many people sitting around predicting things and keeping track of it. The whole monkeys tossing coins argument sounds clever, except that there aren't many monkeys in the real world.