Re:Ask YC: Any ideas about intelligent crawlers :)
by franklymydear on Wednesday January 09, 2008 @05:52AM
(#96302)
Yes, this is close to what I want to do in terms of functionalioty. My idea was to use a wizard-like approach to record the elements of a page that we need to capture and how to navigate through a specific site. They appear to be doing this, though the system has failed a few times on me - they're doing it in a browser, whereas I'd planned to create an app. Very interesting though. Anyone who knows of anything similar or who is interested in building something like this, get in touch
As far as I understand, they are very close to what you are trying to do, so study them carefully as a competitor.