I think the explanation here is that referendum is anonymous, while polls not so much. When questioned by the person doing the poll people tend to give answers that they think are expected from them (i.e. Politically Correct), at referendum they are free to vote according to their actual beliefs.