I may ignore what people say and look what they do. I do this to make people angry :-)
What is the alternative? To tell people how sad it is they can't possibly anything ever? Why bother? Does more harm than good.
You're legitimizing Matt's bullying (by telling people "well, if you don't act counter to game theory and deliberately worsen your own standing, you obviously want to be bullied!") and thus actively telling people "they can't possibly anything ever". What you're doing does far more harm than good.
I've build many great popular things on other people's turf/platforms of which nothing remains.
I have a wp blog too since the beginning! We tried to rebuild our lost communities there. Then akismet started banning people for posting comments with links and I discovered it has no appeal mechanism.
Meet the new boss..
But even when you do that, I'd expect him to just give people an ultimatum - either "officially" host on his plugin directory, or others, but not on both. You'd have to reach critical mass pretty much immediately, or Matt can bully the ecosystem into compliance.