Another important piece of the puzzle here is that politicians commonly update their positions in response to polls. (E.g. "politician X saw a drop in their polls after they said Y") So if polls become unreliable, that is potentially a big loss.