Brutish/opportunistic way out: Be physically large. I don't mean to sound like some kind of Chuck Norris badass — because I am absolutely not — but when I stood up after being similarly challenged the game changed. They didn't even try to show their martial arts skills (of which mine are poor at best tbh) or any other proof they would hurt me. They just up and left.