News for hackers. Stuff that matters.
Re:Show HN: CloudScrape – Cloud-based web scraping platform by kennethologist on Saturday October 17, 2015 @09:14AM (#10404283)
This can become prohibitively expensive even for a small web scraping job that you're required to do everyday. Say scraping a news site for articles.

The tooling and intuitivity is awesome but besides that at the heart doesn't it do what any other headless javascript enabled browser does?

For example: https://phantomjscloud.com/site/pricing.html

Is there a way to get a less feature rich version of this i.e. sans auto-resolve CAPTCHA etc?

Great work none the less though.

Re:Show HN: CloudScrape – Cloud-based web scraping platform by henrik1409 on Saturday October 17, 2015 @01:51PM (#10405331)
Thank your for the kind words :) While you're right that we do run a headless browser-ish thing what sets us apart from most of our competitors, other than the point-and-click approach is that we autodetect everything that's going on in the browser - which also means that in most cases you dont need to know what's going on. What this effectively means is that you'll often spend no time reverse-engineering and be able to scrape even wildly complex javascript-heavy sites in minutes instead of hours - and have them be a lot more stable than they would otherwise since there's no "Wait for 5 seconds" which will only be enough 95% of the time.

We see a lot of our clients manage to do what they need done - even daily scrapes - for as little as $29 / month since scraping a news site daily will often take up no more than a few minutes.

Re:Show HN: CloudScrape – Cloud-based web scraping platform by x5n1 on Saturday October 17, 2015 @04:17PM (#10405878)
Keep your prices, your average developer is not a business person and advises everyone to race to the bottom.
Re:Show HN: CloudScrape – Cloud-based web scraping platform by cookiecaper on Saturday October 17, 2015 @04:33PM (#10405948)
Absolutely. People will always tell you they want everything for either practically or actually free. What they say they'll pay and what they'll actually pay are usually two very different things, assuming you provide something that can't be easily replaced.
Re:Show HN: CloudScrape – Cloud-based web scraping platform by Richdow on Wednesday October 28, 2015 @12:19PM (#10465311)
Agreed! Brilliant tool!
Re:Show HN: CloudScrape – Cloud-based web scraping platform by novaleaf on Sunday October 18, 2015 @10:05PM (#10410719)
Thanks for the link to my service! (PhantomJsCloud)

FYI, I have a public preview of our new version, totally free. Check it out if you find this kind of service interesting! http://stage2.phantomjscloud.com