News for hackers. Stuff that matters.
Re:Web crawler by jafingi on Saturday May 03, 2014 @04:35AM (#7690075)
Well, you'd have to understand the fundamentals of DOM: http://www.w3.org/TR/DOM-Level-2-Core/introduction.html

Also learn about XPath, which is often used as a language to selecting nodes in documents.

Scrapy and BeautifulSoup are popular libraries for scraping in Python.

There are no comments on this comment yet.