News for hackers. Stuff that matters.
Re:Fast scraping in Python with Asyncio by drakaal on Monday March 03, 2014 @01:16PM (#7335317)
Looks ok. I agree with author many people roll their own.

Depending what you want to scrape, this might work better for you.

https://www.mashape.com/stremor/stremor-content-extractor-fa...

It will scrape articles even if they are in multiple divs. It even works on magazine layouts like TheVerge.com that doesn't work in Readability (py, api, or js).

There are no comments on this comment yet.