It's not the content of the subreddits alone, but they inevitably "leak", or actively encourage harassment of people on other subreddits. This is how they can be harmful even to people who never go to the banned subreddit.