An alternative to firing them might have been to re-negotiate their fees based on the less known designer, or to defer payment until the job was finished to your satisfaction.

But given the breach of trust, I don't think canceling the contract was out of line. Especially if staying with them would require extra oversight and heartburn.