News for hackers. Stuff that matters.
Re:New Chrome extension: block sites from Google’s web searc... by Matt_Cutts on Monday February 14, 2011 @04:06PM (#2218665)
I just wanted to say thanks to all the people on Hacker News who asked for this option. We'll look at offering a "block site" option directly in the search results over time, but it takes longer to write, test, and launch that code.

In the mean time, use this extension to clean up your own search results and tell us which sites you don't want to see in Google.

Re:New Chrome extension: block sites from Google’s web searc... by ErrantX on Monday February 14, 2011 @05:42PM (#2219040)
So, does this mean expertsexchange will eventually get shoved down the search results?

(AKA great stuff!)

Re:New Chrome extension: block sites from Google’s web searc... by deltaqueue on Monday February 14, 2011 @09:28PM (#2219824)
Experts exchange answers aren't nearly as bad as things like yahoo answers, etc. (PS - you know the answers are available at the very bottom of the page, right? I thought this was common knowledge, but just wanted to make sure the content was the reason behind the animosity and not that the information used to be inaccessible....)

Perfect example of this extension in action: search for "how to remove ear pads from HD555", and I get a link to this page as the third result: http://www.fixya.com/support/p516634-sennheiser_hd_555_consu...

Totally useless!

Re:New Chrome extension: block sites from Google’s web searc... by vog on Tuesday February 15, 2011 @03:40AM (#2220609)
> Experts exchange answers aren't nearly as bad as things like yahoo answers

While yahoo answers etc. might provide bad answers, experts exchange provides no answers at all. All you see is an open question with a nasty subscribe button that will only work if you haven't already used it more than 30 days ago.

So experts exchange is more than useless: It's just plain advertisement without any added value. It's the kind of stuff you expect in the ads section of a search engine, but definitely don't want to show up in your search results.

Re:New Chrome extension: block sites from Google’s web searc... by phunehehe on Tuesday February 15, 2011 @05:04AM (#2220749)
Well EE is nasty and I hate it, but they have the right if they choose to do so. Anyway they didn't steal the contents from anywhere. That being said, I'll probably add EE to my block list :)
Re:New Chrome extension: block sites from Google’s web searc... by EEvangelist on Tuesday February 15, 2011 @08:01AM (#2221032)
Just scroll down past the stupid paywall when you come from google or bing. Or become an expert for free http://bit.ly/EEfree I have been an expert there (not an employee) since 1998 and it is a great site. For a while now there are free articles and blogs too. I agree with the haters that the paywall should go away, but that is the decision of the owners of EE and those in the know can get full ad-free access by answering approx 3 questions a month. It took me more effort to have a reasonable flair at SO...
Re:New Chrome extension: block sites from Google’s web searc... by vog on Monday February 21, 2011 @05:16AM (#2244948)
> but they have the right if they choose to do so

I don't mind their business model, but I can't understand why they appear near the top of so many search results.

Either they are very good at (mis-)using SEO techniques, or there are really many websites linking to them. However, I personally find it hard to believe that any author of a blog article or forum entry links to an EE answer voluntarily.

Re:New Chrome extension: block sites from Google’s web searc... by Semiapies on Tuesday February 15, 2011 @02:34PM (#2222828)
To third this, scroll down. :)
Re:New Chrome extension: block sites from Google’s web searc... by simpleenigma on Monday February 14, 2011 @06:36PM (#2219251)
I installed the extension and blocked experts exchange first thing ... not sure if I'll even use it for any other sites ...
Re:New Chrome extension: block sites from Google’s web searc... by s3graham on Monday February 14, 2011 @06:51PM (#2219308)
I immediately dropped velocityreviews.com, bytes.com, and about.com too.
Re:New Chrome extension: block sites from Google’s web searc... by SwellJoe on Monday February 14, 2011 @08:25PM (#2219597)
ehow.com, ezinearticles.com. I'm sure there are many others, but those piss me off daily.
Re:New Chrome extension: block sites from Google’s web searc... by lambda on Monday February 14, 2011 @09:30PM (#2219833)
Yeah, those and WiseGeek for me. I keep on getting WiseGeek in searches (especially if I search for a question, which I occasionally do) and the content is complete and utter crap.
Re:New Chrome extension: block sites from Google’s web searc... by user24 on Tuesday February 15, 2011 @04:03AM (#2220633)
eggheadcafe (example: http://bit.ly/fxIaKE )
Re:New Chrome extension: block sites from Google’s web searc... by ErrantX on Monday February 14, 2011 @06:39PM (#2219259)
Snap. I wonder how many others did the same.. going to guess a reasonable number.
Re:New Chrome extension: block sites from Google’s web searc... by Shamiq on Monday February 14, 2011 @08:37PM (#2219638)
Definitely misread that as:

ExpertSexChange

Re:New Chrome extension: block sites from Google’s web searc... by alanh on Monday February 14, 2011 @08:40PM (#2219644)
Yup, that’s why they added hyphens to their domain a few years ago
Re:New Chrome extension: block sites from Google’s web searc... by rapicastillo on Monday February 14, 2011 @08:58PM (#2219722)
Touche! I always get frustrated upon knowing that the answer is blurred and I go "Ack expertsexchange"
Re:New Chrome extension: block sites from Google’s web searc... by RazorSky on Monday February 14, 2011 @11:55PM (#2220202)
OMG that was the first domain I blocked.
Re:New Chrome extension: block sites from Google’s web searc... by demetris on Monday February 14, 2011 @04:31PM (#2218775)
Matt, I don’t understand why Google need to offer blocking as a user option. Any web netizen with some experience can tell at a glance the spammy and low-quality results on a SERP, but Google, with their vast knowledge and experience and their ability to monitor all sorts and aspects of user clicking behaviour, cannot?
Re:New Chrome extension: block sites from Google’s web searc... by Matt_Cutts on Monday February 14, 2011 @04:36PM (#2218800)
I alluded to that in http://news.ycombinator.com/item?id=2218627 . People feel comfortable with Google removing blatant spam: hidden text, cloaking, sneaky JavaScript redirects, etc. People tend to feel less comfortable if they feel like Google is making an editorial decision.

If we get a good signal from this extension, or from offering block links in Google's search results, then it's much more similar Gmail's spam algorithm, where an email is labelled as spam partially because a lot of users say it is, rather than because of some editorial decision on our part.

Re:New Chrome extension: block sites from Google’s web searc... by demetris on Monday February 14, 2011 @05:01PM (#2218879)
Matt, before we get to the point where potentially controversial editorial decisions will have to be made, I would imagine there are things that could be done automatically and uncontroversially.

For example, sometimes we see copies rank higher than originals. Why does that happen? Google know where they first saw a particular piece of content, don’t they? Why don’t they use that as a heavy ranking factor?

Or am I too far off?

Re:New Chrome extension: block sites from Google’s web searc... by thenayr on Monday February 14, 2011 @05:12PM (#2218917)
Consider this: I make a blog post on my relatively new blog examplesite.com. Techcrunch picks up on the article and immediately reposts it on their site. Which do you recon would be the first to get indexed?

Now which is the original from Google's point of view? Relatively smaller blogs can take significantly longer to index then sites that have massive amounts of content moving about daily.

Re:New Chrome extension: block sites from Google’s web searc... by demetris on Monday February 14, 2011 @05:30PM (#2218990)
I have thought about that and I cannot believe it is really a problem.

My small negligible personal website notifies Google, Bing and Yahoo immediately and automatically as soon as I publish something new. It also publishes a feed. Even if the content is picked up and republished right away by a site that is indexed every minute, it should be possible to determine correctly the original publisher.

In some cases, I can think of more ways to determine the original publisher. And certainly Google can think of even more.

Re:New Chrome extension: block sites from Google’s web searc... by subsection1h on Monday February 14, 2011 @06:30PM (#2219235)
> I can think of more ways to determine the original publisher.

Please share them. Thanks.

Re:New Chrome extension: block sites from Google’s web searc... by demetris on Tuesday February 15, 2011 @06:48AM (#2220897)
Here is one scenario that comes easily to mind:

I publish an article at only-original-content.com. The article has some images that are served from only-original-content.com/images. Now only-copied-content.com takes my original article and republishes it. Since only-copied-content simply copied the HTML, the images are still served from only-original-content.com/images.

In that case it should be simple to determine who is the original publisher. Of course, only-original-content.com could simply be a CDN that only-copied-content.com uses for its static resources, but, again, it should be easy to determine whether that is the case.

Re:New Chrome extension: block sites from Google’s web searc... by Matt_Cutts on Monday February 14, 2011 @05:53PM (#2219078)
demetris, that's exactly what we improved with a recent algorithm change: http://www.mattcutts.com/blog/algorithm-change-launched/ . As you point out, that was a more straightforward change, and that's why we were able to launch that one first.

That said, if you wanted to share some examples where you're seeing copies rank higher than originals I'm happy to pass that on to the right folks. In fact, some of the right folks are already on this thread. :)

Re:New Chrome extension: block sites from Google’s web searc... by gmosx on Tuesday February 15, 2011 @03:05AM (#2220548)
posts to google groups show up in devcomments.com, osdir.com, mail-archive.com, etc ranked higher than the original post in google groups.
Re:New Chrome extension: block sites from Google’s web searc... by Matt_Cutts on Tuesday February 15, 2011 @03:35AM (#2220597)
Hmm. That could be if Google Groups has changed the url structure, which could make crawling it harder. Or because USENET/mailing lists don't always have a centralized/canonical location on the web, which makes dupe content more of a potential issue. It's not the usual "Website X copied my website" scenario.
Re:New Chrome extension: block sites from Google’s web searc... by sequoia on Tuesday February 15, 2011 @12:41PM (#2222246)
Getting on a tangent here, but Google has a hard time crawling Google Groups? Have you tried emailing [email protected]? Just kidding but in all seriousness how is it that a Google property has bad SEO?
Re:New Chrome extension: block sites from Google’s web searc... by gmosx on Tuesday February 15, 2011 @01:48PM (#2222605)
still the sites mentioned above are arguably of lower quality than google groups, there is no reason to rank higher...
Re:New Chrome extension: block sites from Google’s web searc... by stanleydrew on Monday February 14, 2011 @05:36PM (#2219015)
You might want to take a look at this:

http://news.ycombinator.com/item?id=2152286

Re:New Chrome extension: block sites from Google’s web searc... by derefr on Monday February 14, 2011 @07:50PM (#2219494)
You already have the SafeSearch filter that can be toggled on and off to show you different search results. Why not an Editorial filter as well (perhaps disabled by default)?
Re:New Chrome extension: block sites from Google’s web searc... by cbs on Monday February 14, 2011 @06:38PM (#2219258)
I understand the fine line you have to walk, and I'm glad to see that you guys take it as seriously as you do.

Personally, I'm glad that you're putting this out as a user-controlled thing. I like the fact I'm able to get rid of results that aren't necessarily spam or SEO'ed garbage, but I where I still know that I never want to see results from that site again.

Re:New Chrome extension: block sites from Google’s web searc... by aubergene on Monday February 14, 2011 @06:06PM (#2219138)
I'm really glad this extension exists.

However, if it is built in to the general results, could you also add a metric to Webmaster Tools showing the frequency with which your domain is reported. It would also be good if the blocking could have timeout period so that sites can be given a chance to improve their behavior, rather than just deleting that domain forever.

Re:New Chrome extension: block sites from Google’s web searc... by davros on Monday February 14, 2011 @08:04PM (#2219547)
+1 to a report in WMT - to detect problems in our sites and also potentially abuse.
Re:New Chrome extension: block sites from Google’s web searc... by scott_s on Monday February 14, 2011 @05:56PM (#2219096)
A "web netizen" is intelligent. Google - as you're using the term - is a sophisticated piece of software that leverages much of what we know about AI, but it is not actually intelligent. The determination you're making that something is spam and not worth your time may be simple for you to make, but it's hard to get software to consistently make the same determination.
Re:New Chrome extension: block sites from Google’s web searc... by mckoss on Tuesday February 15, 2011 @12:19AM (#2220250)
It's one thing for an individual user to ask not to be bothered by results from an entire domain. It's quite another for Google to make that call for EVERYONE. I think this is a great first step. If the evidence is overwhelmingly against a domain, I would hope that Google would use that as a strong negative signal against the domain to adjust the ranking of the site.
Re:New Chrome extension: block sites from Google’s web searc... by narrator on Monday February 14, 2011 @06:49PM (#2219298)
Another thing to keep in mind is to think about how many unique search queries are entered into Google on a daily basis. I don't know what the figure is at Google, but some engineer at Bing said that 25% of searches they've never seen before. You can't get a human to look at each of these searches and remove the content farms, you have to do it algorithmically or else it will never work.

Getting users to do the work will help with the most egregious abuses. One thing that content farms are good at is coming up with answers for questions that don't have an answer available on-line. For example, the query "what's the personal cell phone number of <insert celebrity>?" will just take you to a spam farm because that's the only kind of website that claims to know the answer.

Re:New Chrome extension: block sites from Google’s web searc... by falsestprophet on Monday February 14, 2011 @05:01PM (#2218877)
What role did Hacker News play in bringing about this feature?
Re:New Chrome extension: block sites from Google’s web searc... by omeega on Monday February 14, 2011 @06:19PM (#2219193)
Thats a very important question, as without an answer it seems like the original comment is just excellent Public Relations. *Did not mean to imply that it is PR :)
Re:New Chrome extension: block sites from Google’s web searc... by Matt_Cutts on Monday February 14, 2011 @06:40PM (#2219261)
I asked a member of the webspam team to prototype the extension after reading this Hacker News comment on January 1st: http://news.ycombinator.com/item?id=2058408

We've absolutely done similar things in the past, but that comment was the spark behind this most recent Chrome extension. I hope that's specific enough. :)

Re:New Chrome extension: block sites from Google’s web searc... by dschobel on Monday February 14, 2011 @06:27PM (#2219228)
I think the fact that Matt frequently comes in here to discuss Google's search results shows that it is not just PR.

Unless you want to categorize everything Matt says publicly (whether here, on his blog or on twitter) as PR...

Re:New Chrome extension: block sites from Google’s web searc... by moultano on Monday February 14, 2011 @05:15PM (#2218930)
Market validation. :)
Re:New Chrome extension: block sites from Google’s web searc... by steve19 on Monday February 14, 2011 @06:00PM (#2219113)
Thanks Matt.

Will you be offering a Firefox extension?

Re:New Chrome extension: block sites from Google’s web searc... by blehn on Monday February 14, 2011 @04:12PM (#2218692)
Thanks for listening to our requests!
Re:New Chrome extension: block sites from Google’s web searc... by AlexC04 on Tuesday February 15, 2011 @11:15AM (#2221742)
This is great, thanks Matt.

After using this for less that 12 hours and I think it's fantastic. I also think it could be vastly improved upon. What if you added reddit style "up" and "down" votes to my results?

Maybe it sounds silly at first pass, but if all my votes get passed back to Google, your algorithms could learn from an incredible crowd-source treasure trove of knowledge.

A black list wouldn't just help you find the bad ones - but up-boats could help you suss the good ones.

There's the concern of DIGG style voting blocks, but perhaps even that could be detected by sufficiently sophistimatacted algorithms. (detection of pairity in voting that fell outside of statistical norms could be downgraded in quality).

I mean, sure, I'm already gaming the system in my head ... automated creation of accounts, automated up-boating (which I suspect happens on Reddit as well, despite being bad "reddiquette")

OK. Actually, maybe it's a terrible idea. Like DIGG with only down-votes. Seems like a potential treasure trove though.

Right?

Re:New Chrome extension: block sites from Google’s web searc... by thornjm on Monday February 14, 2011 @10:38PM (#2220028)
In addition to removing the blocked site from the search results would it be possible to be able to remove a site's contribution to pagerank? I feel that this would probably be more effective in the long run...
Re:New Chrome extension: block sites from Google’s web searc... by rakkhi on Monday February 14, 2011 @09:14PM (#2219774)
Matt do you think this will be abused at all? I.e. organized blocking of sites on mass to push it down rankings?

Is your block list something that will be synced so that it is available everywhere you use Chrome and eventually just synced with your Google account?

Re:New Chrome extension: block sites from Google’s web searc... by tchvil on Tuesday February 15, 2011 @01:37AM (#2220393)
On top of counting the block votes, Google could check if the site is crippled by AdSense links. This could filter some shot-down-my-competitor efforts.
Re:New Chrome extension: block sites from Google’s web searc... by tchvil on Tuesday February 15, 2011 @01:42AM (#2220401)
Do you plan to release the list of blocked sites to the public?