What's really hurt the mod scene is fragmentation - search for Minecraft Mods on Google and the unofficial-official Curse forums will probably come up but there's also many other sites that re-host (with more ads).

I've heard anecdotal reports of malware being spread through these unofficial mirrors too.

Can you imagine if there had been mods.minecraft.com from the start with some kind of central organisation?