Interestingly that's how Aether (https://getaether.net/) works: mods don't control rooms unilaterally, they are voted in. If you don't agree with what a mod did, you can disregard whatever action they took. _All_ content is available locally, you only apply the filter you want.

I've never used Aether but I find that way of working very refreshing.