You're leaping to an incredibly negative assumption of the speaker's intent, and then onto a form of punishment for that person. I think the "assume good intent" approach is more appropriate in these kinds of situations where it's incredibly ambiguous.