Because they were a small party in a coalition with a larger party that did some horrible things. Their core voters deserted them, since they were in government when things were brought in that their core didn't like.

Always the way with small parties in coalition.