The right to carve out a space (on the Internet or otherwise) for certain like minded individuals to be "safe" from any of the things you mentioned, as well as any other things they may deem fit, is one that we should generally honor, though.
Changing the rules after people have invested their time and effort into being part of a community with certain norms is generally a crappy thing to do. This is the internet, where anyone can start their own community with their own rules in any number of ways. The rights of the people that were there first should be recognized.
Why not give mods a knob that auto kills ninety percent of the stuff they end up deleting, to keep them from just getting worn down dealing with this shit?
For my own part, the 'non credible' threats are a huge part of the problem. They stop being non credible if there's enough of them, or if you're getting private messages from people with your home address and a rapid or murder threat. That's the level of unsafe that I'm talking about here. And communities need the tools to stop bullshit before it gets out of hand. I actually think that the sort of over reactionary pc-ness that Steven Fry is concerned about could be a reaction to a lack of such tools.
Safe from what? From having your views challenged? From someone calling you an asshat? From people making non-credible threats (Think navy seal copypasta)? From people making legitimate threats?
Talk to 10 different people and all will have different definitions as to what the meaning is there.