News for hackers. Stuff that matters.
Re:A guide to the latest Mahalo spam techniques by jellicle on Thursday June 17, 2010 @12:18PM (#1439387)
Google, for whatever reason, thinks that a very light touch with regard to spam sites is appropriate. (Although Cutts is right that an inurl: or site: query doesn't show anything - he's saying, "Show me a real-world query that has nothing but spammy results and then I'll do something").

I think and have thought that a Google competitor could come along and beat them by having a heavy hand against spam sites. If it's designed to attract search engines, NewGoog doesn't index it, period. Any business generating datafog for search engine consumption gets deindexed entirely and permanently.

Go ahead, type any question you want into Google. ANY question at all. You get a list of 500 search engine question spam sites, most of which are written in broken English and contain more or less nonsense strings of words thrown together. NewGoog would wipe all that shit out.

Attention Google: offer an option (like SafeSearch) that applies a HEAVY HAND to spam sites. We will love you for it.

Re:A guide to the latest Mahalo spam techniques by ryanhuff on Thursday June 17, 2010 @01:52PM (#1439743)
What's the best way to pass a site over to Matt Cutts?

This site has GOT TO GO! http://www.codeweblog.com/ It is polluting my Google search results.

As an example, search for "android intent activity pass". The search result titled "android intent pass variable activity" looks promising, but clicking on it brings you to this site, which contains machine generated nonsense content!

Re:A guide to the latest Mahalo spam techniques by percept on Thursday June 17, 2010 @02:27PM (#1439893)
I've also been seeing it regularly in technical search results, and it seems to have come from nowhere as I don't remember ever seeing it before (the domain's associated with a Chinese address, created 2006).
Re:A guide to the latest Mahalo spam techniques by jpenney on Thursday June 17, 2010 @05:57PM (#1440520)
I submitted a spam report about that site the other day. I've been getting up to scratch on ruby and a lot of searches for gem names return that site. I have gotten so used to trusting the top results in Google that I never think to check the domain - I need to stop that.
Re:A guide to the latest Mahalo spam techniques by benologist on Thursday June 17, 2010 @09:16PM (#1440987)
My favorite is bigresource.com and others that are scraping forums ... fucking hate those sites so much, reported them but of course those emails go nowhere.
Re:A guide to the latest Mahalo spam techniques by mvandemar on Thursday June 17, 2010 @02:16PM (#1439852)
Are those Markovian chains, or is someone actually writing that stuff?
Re:A guide to the latest Mahalo spam techniques by jraines on Thursday June 17, 2010 @07:16PM (#1440752)
This site was killing me just last night! (I was looking for info on CKEditor plugins)
Re:A guide to the latest Mahalo spam techniques by epi0Bauqu on Thursday June 17, 2010 @02:57PM (#1439997)
I do this at DuckDuckGo, that is crawl, identify and delist over 60M domains. I think it works pretty well and is certainly a value add, but it is not immediately obvious to new or even many old users.
Re:A guide to the latest Mahalo spam techniques by thaumaturgy on Thursday June 17, 2010 @06:19PM (#1440610)
Just a heads-up for you, and I'm sure you get this all the time, but I'm a new DDG fan.

The first time I tried it some months back, it was eh-OK, but not compelling enough to pull me away from Google. In the meantime though, I've gotten more and more frustrated with Google's results -- due in part to link-spamming sites -- that DDG has become a lot more compelling. It's my default search provider now.

One question though: I commented to a good old friend of mine that search was starting to feel like the old AltaVista days again. I spent a lot of time trying to find a site that I had seen just a couple of weeks previously, and no amount of Google-fu (or Duck-fu) could locate it. I kept getting completely generic results that weren't helpful at all. I finally found it by remembering where I had seen the link, and using a custom search feature on that site in particular.

So ... is there a way for a search engine to rank pages by "freshness"? i.e., some combination of recently-updated and recently-mentioned?

Anyway, thanks for DDG.

Re:A guide to the latest Mahalo spam techniques by derefr on Thursday June 17, 2010 @09:13PM (#1440983)
Google exposed some sort of recency-based filtering UI with their latest update, although I'm not sure how it gets its results.
Re:A guide to the latest Mahalo spam techniques by epi0Bauqu on Thursday June 17, 2010 @09:22PM (#1440998)
Thx for the heads-up. This is very helpful feedback.
Re:A guide to the latest Mahalo spam techniques by smiler on Friday June 18, 2010 @06:35AM (#1441829)
Remedy for this is to bookmark a site you like :)