The Freedom Riders did something fundamentally abhorrent to southerners. They went into white establishments as black people (or accompanying black people). It's only because of changing norms that we don't see their actions as horrifically rude or even violent in nature.