If that mass doesn't accumulate fast enough he is right and people want him to run things the way he does. It might look weird to me or others, they might even say the opposite but only ones actions count.
No, that's not how consent and preferences work. If someone has power over a group of individuals, and that group doesn't act due to threats, it's not confirming that they want to be controlled by that someone.
You're completely ignoring that the individuals have a high risk when doing this, even more so when they are the first to take this step. It can often happen that individuals make choices to minimize risk, which lead to increased risk for the whole group. It's just game theory. But it sounds like you're ignoring this deliberately to make people angry, so I'll leave you with one last thought:
You're legitimizing Matt's bullying (by telling people "well, if you don't act counter to game theory and deliberately worsen your own standing, you obviously want to be bullied!") and thus actively telling people "they can't possibly anything ever". What you're doing does far more harm than good.
I suppose the only advice one can give are things one would do in that situation.
I've build many great popular things on other people's turf/platforms of which nothing remains.
I have a wp blog too since the beginning! We tried to rebuild our lost communities there. Then akismet started banning people for posting comments with links and I discovered it has no appeal mechanism.