Yeah, I think that's it, or at least a large part of it. People were unhappy and when you're unhappy you vote out the incumbent (and in a two-party system there's only one other choice).

I also think that's the same reason the exact same guy was voted out four years ago. Pretty bizarre if true, so it's probably not the whole story.