Not wanting to compromise comes largely from the two-party system. If a politician had to worry about losing votes to a more moderate party, they'd end up with less extreme voting records.

Multi-party governments function largely because some subset of the parties agrees to compromises to gain a combined majority on a specific topic; none of them can do anything in isolation.