News for hackers. Stuff that matters.
Re:New Chrome extension: block sites from Google’s web searc... by demetris on Monday February 14, 2011 @05:01PM (#2218879)
Matt, before we get to the point where potentially controversial editorial decisions will have to be made, I would imagine there are things that could be done automatically and uncontroversially.

For example, sometimes we see copies rank higher than originals. Why does that happen? Google know where they first saw a particular piece of content, don’t they? Why don’t they use that as a heavy ranking factor?

Or am I too far off?

Re:New Chrome extension: block sites from Google’s web searc... by thenayr on Monday February 14, 2011 @05:12PM (#2218917)
Consider this: I make a blog post on my relatively new blog examplesite.com. Techcrunch picks up on the article and immediately reposts it on their site. Which do you recon would be the first to get indexed?

Now which is the original from Google's point of view? Relatively smaller blogs can take significantly longer to index then sites that have massive amounts of content moving about daily.

Re:New Chrome extension: block sites from Google’s web searc... by demetris on Monday February 14, 2011 @05:30PM (#2218990)
I have thought about that and I cannot believe it is really a problem.

My small negligible personal website notifies Google, Bing and Yahoo immediately and automatically as soon as I publish something new. It also publishes a feed. Even if the content is picked up and republished right away by a site that is indexed every minute, it should be possible to determine correctly the original publisher.

In some cases, I can think of more ways to determine the original publisher. And certainly Google can think of even more.

Re:New Chrome extension: block sites from Google’s web searc... by subsection1h on Monday February 14, 2011 @06:30PM (#2219235)
> I can think of more ways to determine the original publisher.

Please share them. Thanks.

Re:New Chrome extension: block sites from Google’s web searc... by demetris on Tuesday February 15, 2011 @06:48AM (#2220897)
Here is one scenario that comes easily to mind:

I publish an article at only-original-content.com. The article has some images that are served from only-original-content.com/images. Now only-copied-content.com takes my original article and republishes it. Since only-copied-content simply copied the HTML, the images are still served from only-original-content.com/images.

In that case it should be simple to determine who is the original publisher. Of course, only-original-content.com could simply be a CDN that only-copied-content.com uses for its static resources, but, again, it should be easy to determine whether that is the case.

Re:New Chrome extension: block sites from Google’s web searc... by Matt_Cutts on Monday February 14, 2011 @05:53PM (#2219078)
demetris, that's exactly what we improved with a recent algorithm change: http://www.mattcutts.com/blog/algorithm-change-launched/ . As you point out, that was a more straightforward change, and that's why we were able to launch that one first.

That said, if you wanted to share some examples where you're seeing copies rank higher than originals I'm happy to pass that on to the right folks. In fact, some of the right folks are already on this thread. :)

Re:New Chrome extension: block sites from Google’s web searc... by gmosx on Tuesday February 15, 2011 @03:05AM (#2220548)
posts to google groups show up in devcomments.com, osdir.com, mail-archive.com, etc ranked higher than the original post in google groups.
Re:New Chrome extension: block sites from Google’s web searc... by Matt_Cutts on Tuesday February 15, 2011 @03:35AM (#2220597)
Hmm. That could be if Google Groups has changed the url structure, which could make crawling it harder. Or because USENET/mailing lists don't always have a centralized/canonical location on the web, which makes dupe content more of a potential issue. It's not the usual "Website X copied my website" scenario.
Re:New Chrome extension: block sites from Google’s web searc... by sequoia on Tuesday February 15, 2011 @12:41PM (#2222246)
Getting on a tangent here, but Google has a hard time crawling Google Groups? Have you tried emailing [email protected]? Just kidding but in all seriousness how is it that a Google property has bad SEO?
Re:New Chrome extension: block sites from Google’s web searc... by gmosx on Tuesday February 15, 2011 @01:48PM (#2222605)
still the sites mentioned above are arguably of lower quality than google groups, there is no reason to rank higher...
Re:New Chrome extension: block sites from Google’s web searc... by stanleydrew on Monday February 14, 2011 @05:36PM (#2219015)
You might want to take a look at this:

http://news.ycombinator.com/item?id=2152286