I'm a non-confrontational person myself actually. It took me over 35 years to learn being that direct is actually less stressful in certain circumstances. Quite arguably, I'm still learning it. We get it in our heads that we owe the asshole an explanation. That's a trap. The explanation becomes it's own source of stress. Odds are strong, the asshole knows they're being an asshole. No, explanation is required.