I would, but then I'm the only one that knows the tone it was said in (at least in my head), which wasn't condescending, but more bemused sarcasm.

And that's the fundamental issue with moderating rhetorical devices. You're assuming you know how the other person intended to say something.

Moderating personal attacks is easy. Because that's not a rhetorical device and it's intent is quite clear.