Re:Trouble In the House of Google
by mootothemax on Monday January 03, 2011 @08:05AM
(#2063003)
That seems good -- but I can imagine Google preferring to crawl the page, rather than receive it by API
I'd agree with you, but can think of edge cases where naughty sites A, B and C submit new URLs within an arbitrary amount of time of the new content being published. In that case there'd be no way for Google to tell who published the content first other than to have a big list of original content publishers - and I think that list'd get messy fast.
I think Google can handle the scaling problem; one not-great solution: ignore notifications except for those from people who are being scraped and need it.
Still, it's kind of a shame that webmasters have to worry about any of this.