Are you really asking why the line is drawn between "just making harmless jokes" and "making jokes at the expense of another group"? You don't have to agree, but I think the difference and why someone would suggest that's where the line should be drawn is obvious.