News for hackers. Stuff that matters.
Re:Palantir acquires Kimono by ddebernardy on Tuesday February 16, 2016 @05:15AM (#11108916)
Three more:

https://github.com/scrapinghub/portia/ (our open source equivalent of Kimonolabs)

http://scrapy.org (allows to scrape more complex sites; also OSS)

http://scrapinghub.com (for a cloud-based platform and a smart proxy rotator)

(Disclaimer: working there.)

Re:Palantir acquires Kimono by kumarski on Tuesday February 16, 2016 @04:31PM (#11113269)
scrapinghub is pricy, isn't it?
Re:Palantir acquires Kimono by ddebernardy on Tuesday February 16, 2016 @05:42PM (#11113718)
Pricey as in we've a free plan? :-)

More seriously though, it's basically a bargain. You get:

- Access to the largest team of Scrapy, Portia, and Frontera experts around at your fingertip.

- AWS functionality for actually less than what it would cost you to set things up yourself (think VBR IP over ATM).

- Smart proxy rotating tech at your fingertip with tens of thousands of IP addresses spread across a slew of different IP networks.

- Built-in integrations with a growing list of third parties.

The list could go on and on... It's definitely not pricey. :-)

Re:Palantir acquires Kimono by webrobots on Tuesday February 16, 2016 @04:16PM (#11113187)
https://webrobots.io - we give free Chrome extension to run scraper robots on your own computer. For paid customers we host robust cloud of scraping instances with all advanced features one can expect. To be fair - you need to understand javascript to write robots on our platform, we are not point-and-click doodling tool. Upside of writing robots in code - nearly unlimited possibilities with dynamic content sites, in-flight data cleaning, etc.
Re:Palantir acquires Kimono by outdooricon on Monday February 15, 2016 @06:50PM (#11106958)
Was really hoping someone would share a comment like this, thank you. I feel like I just got completely screwed by Kimono...
Re:Palantir acquires Kimono by henrik1409 on Tuesday February 16, 2016 @07:40AM (#11109428)
Re:Palantir acquires Kimono by dwynings on Monday February 15, 2016 @07:53PM (#11107213)
Re:Palantir acquires Kimono by jdc0589 on Tuesday February 16, 2016 @10:21AM (#11110364)
damn. I was gonna say this means it's time to actually launch my version of this I built 3 of 4 years ago, but it looks like apifier is almost the exact same thing.....
Re:Palantir acquires Kimono by ultimatejman on Tuesday February 16, 2016 @05:08AM (#11108896)
i have found import.io to be pretty good
Re:Palantir acquires Kimono by Harshita on Tuesday February 16, 2016 @07:03AM (#11109293)
Have you tried pulling out anything from LinkedIn there?