News for hackers. Stuff that matters.
Re:Of Spiders and Scrapers: Decomposing Web Pages 101 by jm4 on Thursday July 30, 2009 @08:41AM (#732045)
Huh? The guy wrote this article for the same magazine he scraped articles from back in 2005 so I'm assuming he has, at the very least, some sort of affiliation with them. It sounds like it was part of a data migration strategy rather than theft.
Re:Of Spiders and Scrapers: Decomposing Web Pages 101 by miracle on Thursday July 30, 2009 @09:25AM (#732134)
Scraping is theft. Alone downloading and storing a copyrighted article is forbidden by law in certain countries.

It doesn't matter if you make the article public then or not.

Re:Of Spiders and Scrapers: Decomposing Web Pages 101 by silentOpen on Thursday July 30, 2009 @11:48AM (#732446)
Sorry but this just isn't how the web works. Scraping is identical to crawling is identical to browsing is identical to caching.

Republishing someone else's work without their permission is probably copyright infringement but just downloading and parsing it is not.

Re:Of Spiders and Scrapers: Decomposing Web Pages 101 by miracle on Friday July 31, 2009 @08:18AM (#734228)
That's not true.

The european legislation has explicitely made an exception taht you are able to download and cache the document, as long as it is necessary for something to work (eg browser). Or if you are using it for personal use only.

But otherwise, storing a copyrighted document is illegal (interstingly twitter messages are not considered copyrighted).

Re:Of Spiders and Scrapers: Decomposing Web Pages 101 by vdm on Thursday July 30, 2009 @11:19AM (#732382)
Somebody should tell Google.
Re:Of Spiders and Scrapers: Decomposing Web Pages 101 by Ardit20 on Thursday July 30, 2009 @08:56AM (#732075)
Yes, I realised that after reading the quote another three times. The article itself however seems to be about scrapping, or theft, so I thought that quote describes what he does well, but of course failed to see that he works for Linux Magazine.
Re:Of Spiders and Scrapers: Decomposing Web Pages 101 by jm4 on Thursday July 30, 2009 @09:19AM (#732120)
Scraping itself is not theft. It could be used to commit theft, but there are far more legitimate uses.