However I agree with you in as much as, if some folks who think its a good idea all get together and communicate it clearly, there's nothing wrong with that. I probably wouldn't go, but there's a lot of conferences in the world I don't "get" and have no desire to go to, and that's ok.
I've also seen someone asked to cover up a company T with an IMO utterly innocuous joke on it (at a different event).
But, yeah, if you want to run a conference with a CoC that basically says we'll ask you to leave if anyone is offended by you for any reason, just please let me know so I can choose not to attend.
There are spaces where it doesn't make sense - for you -. Any forum where criticism is not acceptable should be classified as advertising or possibly propaganda.
What I reject is the idea that all spaces are somehow required to make space for criticism. There are spaces where that rule doesn't make sense.
We're unlikely to find people to argue that the conference handled this well, or that the author did anything wrong.