News for hackers. Stuff that matters.
Re:A group of 3,000 citizens is making better forecasts than... by joshuahedlund on Wednesday April 02, 2014 @09:19AM (#7515263)
This Economist post[0] addresses some of the many comments about statistical outliers:

> The big surprise has been the support for the unabashedly elitist “super-forecaster” hypothesis. The top 2% of forecasters in Year 1 showed that there is more than luck at play. If it were just luck, the “supers” would regress to the mean: yesterday’s champs would be today’s chumps. But they actually got better. When we randomly assigned “supers” into elite teams, they blew the lid off IARPA’s performance goals. They beat the unweighted average (wisdom-of-overall-crowd) by 65%; beat the best algorithms of four competitor institutions by 35-60%; and beat two prediction markets by 20-35%

[0]http://www.economist.com/news/21589145-how-sort-best-rest-wh...

Re:A group of 3,000 citizens is making better forecasts than... by blake8086 on Wednesday April 02, 2014 @01:59PM (#7517590)
I would bet that the only reason they're beating prediction markets is because the markets aren't "real money" or they aren't able to participate in them.

If they were, they would go make money in the prediction markets, and the prediction markets would become more accurate.

Re:A group of 3,000 citizens is making better forecasts than... by TrainedMonkey on Wednesday April 02, 2014 @03:29PM (#7518301)
Could this be simple selectivity? I do not know how CIA selects analysts, but I doubt it is by having large pool of applicants that are evaluated on their predictions. On the other hand we have group of 30 people, selected for their guessing from amongst 3000 population. When put that way, I would expect 30 people to be consistently better.
Re:A group of 3,000 citizens is making better forecasts than... by akira2501 on Wednesday April 02, 2014 @07:41PM (#7519855)
These people are also isolated from the internal agency narrative, I imagine that can help quite a bit.
Re:A group of 3,000 citizens is making better forecasts than... by negativity on Wednesday April 02, 2014 @10:17PM (#7520504)
In other words, what if the "taxpayer-funded" forecasts we're permitted to know about are "on the books", so to speak, and so much more is "off the books" and memory-holed beyond even the typical "black magic marker, and white out" form of redacted classification that some times surfaces into the public eye?

Truths so brutal, and predictions so harsh that no one dares write them down.

But now we enter the information age, and certain realities are essentially undeniable, and can no longer concealed from the civilian panopticons like Google.

Sort of like how TV Networks (and even basic cable channels to a degree), with their Standards & Practices departments, waste time sanitizing television destined for the public air waves and radio spectrum, while media on the internet operates with an almost total lack of restraint.

Re:A group of 3,000 citizens is making better forecasts than... by wisty on Thursday April 03, 2014 @03:45AM (#7521440)
You can find ads online.

Basically, get a degree in a related field (international politics, security, languages, demographics, economics, etc), and have decent marks. Apply. Don't tell anyone (until they have briefed you on what you can say). Don't have any skeletons in your closet.

It's basically like getting a USAID job, but probably not as competitive (lots of funding = lots of positions, and most people doing these kinds of degrees tend to not be very pro-defence) and with slightly higher security requirements.

Re:A group of 3,000 citizens is making better forecasts than... by standeven on Wednesday April 02, 2014 @08:02PM (#7519943)
Predictions are all about discerning signals from noise, and some people seem to be naturally better at discernment. I'm sure it can be learned as well (to a degree), but I'm not at all surprised that some people are exceptionally better than others.
Re:A group of 3,000 citizens is making better forecasts than... by lostcolony on Wednesday April 02, 2014 @10:47AM (#7515878)
Very nice. Thanks for finding that.
Re:A group of 3,000 citizens is making better forecasts than... by ctlaltdefeat on Wednesday April 02, 2014 @01:05PM (#7517017)
>If it were just luck, the “supers” would regress to the mean: yesterday’s champs would be today’s chumps.

huh?

Re:A group of 3,000 citizens is making better forecasts than... by epi8 on Wednesday April 02, 2014 @01:08PM (#7517057)
If I just got really freaking lucky with my predictions yesterday, then there's no reason to imagine I would get really freaking lucky again. Over time, my average accuracy would become the mean of the distribution.

On the other hand, if I actually _am_ good at making predictions, then I will continue to make good predictions.