A failure I've noted over the past 20 years or so of various collaborative filtering systems, where some function of votes on what is "better" are used, is that many of them degrade essentially to a popularity contest. This can be good if you're trying to optimise for "what will sell the most", but doesn't end up so well if you're looking for "what's the most correct" or "what has the greatest truth value" from among options.
It's commonly noted as the hivemind effect, in a negative sense, particularly where the hivemind (or the effectively expressed result of it) tends to quash correct-but-unpopular views.
That said, I've been watching elections and presidential politics in the US very closely since Watergate. Trump is very likely to win this election. There are many factors in play that the pundit and pollster class don't understand, and don't seem to care to understand. In this scenario, both the large crowds (polls) and the moderate crowds (expert panels) are likely to miss the mark by wide margins.
This is not because the experts lack expertise, but rather because this election has some unusual features that have not been seen for a couple of generations at least, and their models (mental and statistical) don't seem to be taking account of that. Humans have a nasty habit of switching motives without notice.
If the markets predicted 75% A vs 25% B and A always turned up, that would make them a poor prediction. Predicting 25% B may mean they're not making much of a prediction (since they're not so far off from 50/50), but it doesn't mean that B being the outcome is indicative of a the prediction being deeply wrong.
The way to measure that is to look at 100 cases where prediction markets predict 75% odds. If approximately 75 of them result in a winner, prediction markets are accurate.
Looking at a single data point and declaring a probabilistic predictor to be inaccurate is not even wrong.
(I wont say its 100% today because I've heard of at least 3 scenarios so far in which Brexit may not truly happen.)
If it does, then the noise of experts clashing (resolving conflicts between equally informed ideas) starts outweighing the benefits of them contributing the ideas to begin with. Basically you get a too many chiefs issue.
If it doesn't, you're seeking to average variably-educated wild ass guesses and taking advantage of the fact that WAGs have a tendency to form a bell curve around the actual answer if there's any ability to estimate whatsoever. Since there's otherwise no special knowledge, that ends up being the best you can get but requires a lot of people to get right.
Without having read up on it, my guess is the latter is related to central limit, with each person's WAG forming the first term of the mean of means; a WAG is itself sampling your own mental model and boiling it to a number. Given enough of those you get a normal that you can average.