Show HN: Screen scraping for dummies app

Re:Show HN: Screen scraping for dummies app by justliving on Tuesday June 21, 2011 @08:20AM (#2678423)

nice! What are your future plans for it? E.g. which features do you plan to add for my grand-mother :-) ?

[ Parent | on HN ]

Re:Show HN: Screen scraping for dummies app by combiclickwise on Tuesday June 21, 2011 @08:32AM (#2678456)

thanks. couple of things I have in mind

1. more output formats like JSON, HTML, Doc, RSS, ATOM

2. allow programming in loops.. for example you want to be able to scrape many pages of data for a google search result then you need a hack in the url itself. This is difficult to accomplish but I am think I can add support to some of the pagination patterns to start with

3. to be able to give more control over the HTML, maybe a panel which helps extract the relevant one from the target page

[ Parent | on HN ]

Re:Show HN: Screen scraping for dummies app by justliving on Tuesday June 21, 2011 @09:34AM (#2678655)

sounds good! I like especially 1/ and would add a dead simple API to it! Is this part of your plans?

Besides, it might be intersting to play around w/ your stuff and yahoo-pipes.

[ Parent | on HN ]

Re:Show HN: Screen scraping for dummies app by combiclickwise on Tuesday June 21, 2011 @01:09PM (#2679534)

Oh and please use it if you want to... I will make sure I reserve a free place for you in case I go the paid route later on :-)

my email is in my profile so you can send me yours.

[ Parent | on HN ]

Re:Show HN: Screen scraping for dummies app by combiclickwise on Tuesday June 21, 2011 @01:01PM (#2679495)

yes. API is definitely a part of it and yes, I was thinking about yahoo pipes as well. :-)

[ Parent | on HN ]