The fact that they've disinvited him so publicly and so strangely is itself an insinuation. Quite a strong one, in fact.

Imagine your child was expelled from your local school and the reason given was "she made others feel uncomfortable". And that was the end of the discussion.