That interpretation doesn't follow from GP's position of "if you are deciding what is acceptable speech, you're now responsible for it."

Removing off-topic posts is just as much "deciding what is acceptable speech" as is removing on-topic posts that happen to be posts I don't like. That is to say, the consideration of what is on-topic vs. off-topic is at its core a decision of what is acceptable.