News for hackers. Stuff that matters.

A comment on Scraping made easy with jQuery and SelectorGadget (and Node.js!). Parent comment

Re:Scraping made easy with jQuery and SelectorGadget (and No... by mishoo on Saturday January 22, 2011 @09:05AM (#2130407)
... and later you begin to discover different, much better ways to solve problems that you used to do with regexps, and your life will get back to normality and happiness. ;-)

For a solid scrapper in Perl I'd use HTML::TreeBuilder / HTML::Element. Perhaps slower than regexps, but does real parsing and understands tag-soup HTML.

[ Parent | on HN ]
Re:Scraping made easy with jQuery and SelectorGadget (and No... by parasctr on Saturday January 22, 2011 @02:51PM (#2130914)
These modules are very resource intensive and they become a bottleneck if you are scraping at high volume. I had to stop using these modules in one of my tools because of that reason. However, for smaller jobs they are awesome and much easier to use and understand.
[ Parent | on HN ]