It's more about changing power ratio between parties rather than unseating a specific politician. If a known politician fucks up badly, they can get elected next time even if their party support drops a lot. And that's still a win for the opponents.