News for hackers. Stuff that matters.

A comment on Ask YC: Any ideas about intelligent crawlers :).

Re:Ask YC: Any ideas about intelligent crawlers :) by DarrenStuart on Tuesday January 08, 2008 @04:52PM (#96132)
I know this is ruby but might be worth a look. Will help you no end and no need for a web browser.

http://mechanize.rubyforge.org/mechanize/

might be worth a look http://www.crummy.com/software/BeautifulSoup/

[ Parent | on HN ]

There are no comments on this comment yet.