Actually, we do in fact say that X is a jerk over the telephone but less so in person. It's pretty well studied. The generic term is "psychological disinhibition" and it used to come up all the time around the issue of email and tone.