Depending on the contract and the law, the other party being in breach of contract does not mean you can, without consequence, also breach the contract. You signed the contract so you are bound to the contract, not to the other party.

In other words: two wrongs don't make a right ;)