It's still a fight. giving an inch, or letting up allows your opponent back into the fight.

What you are alluding to is the idea that he could beat him with a hand behind his back so to speak. (Which might be true) but could be perceived as even more disrespectful imo.