Commercial sites now have to deal with a full page of ads before the real results so their fate is sealed another way. In other words, we need 4-5 search engines, not one giant monopoly that seeks to increase ad clicks by underhanded methods each quarter.
I bet MeFi could be fixed in a few months if they hired a real SEO expert, ie someone who understands the underlying ranking algos and not just the usual voodoo bullcrap. The site is probably just tripping a few red flags, it could be something as stupid as an accidental link loop in their dynamic content.
I'll give it to Google, once you find your sin and fix it, your traffic will come back, maybe not 100% but a significant recovery. (Unless you have done something really dumb/blackhat like paid links.)
This is not always the case. Look at the Rapgenius event. That was triggered by manual intervention.
>I bet MeFi could be fixed in a few months if they hired a real SEO expert, ie someone who understands the underlying ranking algos
There isn't anyone on the outside that truly understands them because they constantly adjust them to deal with abuse. It is possible that one of these adjustments killed MeFi and it wasn't a recent mistake on MeFi's part.
While they can slap a manual -50 penalty on your domain, from memory you are notified of such penalties in Google Analytics so it's not a silent and nefarious manipulation. MeFi should know if they have such a penalty. I also admit that the "get out of jail" process is even more annoying than dealing with an Apple app store rejection.
So call it manual, algorithmic, display change or whatever, you're f-ed and call moves more of web traffic to its own properties.
Most people bleat "just write good conteeeeent" and have no idea how Google ranking actually works. I guess what was most galling was seeing certain retail sites getting away with blatant spam while your own sites got mysteriously slammed.
I don't blame Google though - it's a direct result of having a single player market. So go, duckduck, go :)