Re:Show HN: Screen scraping for dummies app
by justliving on Tuesday June 21, 2011 @09:34AM
(#2678655)
sounds good! I like especially 1/ and would add a dead simple API to it! Is this part of your plans?
Besides, it might be intersting to play around w/ your stuff and yahoo-pipes.
Re:Show HN: Screen scraping for dummies app
by combiclickwise on Tuesday June 21, 2011 @01:09PM
(#2679534)
Oh and please use it if you want to... I will make sure I reserve a free place for you in case I go the paid route later on :-)
my email is in my profile so you can send me yours.
Re:Show HN: Screen scraping for dummies app
by combiclickwise on Tuesday June 21, 2011 @01:01PM
(#2679495)
yes. API is definitely a part of it and yes, I was thinking about yahoo pipes as well. :-)
1. more output formats like JSON, HTML, Doc, RSS, ATOM
2. allow programming in loops.. for example you want to be able to scrape many pages of data for a google search result then you need a hack in the url itself. This is difficult to accomplish but I am think I can add support to some of the pagination patterns to start with
3. to be able to give more control over the HTML, maybe a panel which helps extract the relevant one from the target page