News for hackers. Stuff that matters.
Re:I Don’t Need No Stinking API: Web Scraping For Fun and Pr... by latchkey on Sunday December 09, 2012 @12:38AM (#4893932)
In most cases, the site doesn't have an api... so we scrape and take the risk that the structure will change. One thing that helps is using tools which give you jquery-like selectors because they give a lot of freedom and are very easy to write/update.
Re:I Don’t Need No Stinking API: Web Scraping For Fun and Pr... by lazyfunctor on Sunday December 09, 2012 @10:52PM (#4897410)
I agree, CSS selectors in BeautifulSoup and pyquery make it less messy.