It boils down to: a fraction of the electorate will vote for $bigotcandidate but would never ever admit it to anyone outside the voting booth, because they know it is wrong. They will tell people they will vote for $notbigotcandidate, but vote for him nonetheless.
This fraction is not insignificant and you cannot easily represent it in polls without guessing the effect. In my home province it eas consistently around 10 to 15% over a decade.
The publicly available polls are done for free by polling companies or by news organizations. Unfortunately some of these companies apparently have an agenda to push. So they skew their sample away from what the likely voters are to get the result they want for propaganda purposes.
I think that the rise of Nate Silver has ironically made this situation worse. He advocates taking an average of polls to get a true view of the situation. So if you are skewing you poll to get a certain outcome and you know the poll will be averaged, you need to warp your results even further.
Ok, disclaimer time - I don't have any inside knowledge or real evidence of any of the above. It does seem to fit however. I can't explain why it seems all the distorting is to make the Dems lead seem bigger than it is - that is, why aren't there pollers on the other side of the aisle doing the same thing?
So you'll have to decide for yourself if there is any merit to the above theory.
I've heard several hypotheses, but I don't have anyway to test them. They all seem to have merit.
I think we have to seriously consider that Trump just breaks things that otherwise would be working within reason.
Accurate polls are important to running campaigns and to legislative positions. Selzer got her polls right in Iowa and she posited that she knew the local electorate better than other pollsters so she weighted correctly. Maybe Trafalgar Group has a better method or maybe it just weights GOP voters more heavily (we don’t know, it won’t disclose its methods). Or maybe Trump just breaks polling and the polls will be fine next time. Whatever the reason, I’d like to know, but I’m not sure we ever will.