Ask HN: What are best tools for web scraping?

Re:Ask HN: What are best tools for web scraping? by rosha on Tuesday November 14, 2017 @01:02PM (#15697496)

thanks, I just talked to their support and got onboard very quickly, seems to work good for LinkedIn but only if support activates the token for you.

[ Parent | on HN ]

Re:Ask HN: What are best tools for web scraping? by ajimix on Tuesday November 14, 2017 @01:05PM (#15697516)

yes I also had to contact them in the past to activate linkedin scraping. Now it's perfect without blocks :)

[ Parent | on HN ]

Re:Ask HN: What are best tools for web scraping? by altareq on Tuesday November 14, 2017 @01:07PM (#15697542)

how long have you been using ProxyCrawl? I have rate limit to linkedIn and I want to buy a bigger package, do you recommend?

[ Parent | on HN ]

Re:Ask HN: What are best tools for web scraping? by ajimix on Tuesday November 14, 2017 @01:14PM (#15697600)

I've been using it for around 3-4 months with different sites. For linkedin it's been a bit more than 2 months. They are a good startup and they've been improving a lot their services. They only count successful requests so you don't have to worry about fails. If you get a bigger package they will raise your limits I guess. But I suggest that you contact them directly

[ Parent | on HN ]

Re:Ask HN: What are best tools for web scraping? by rosha on Tuesday November 14, 2017 @01:10PM (#15697564)

support says, the rate limit for LinkedIn can be increased on bigger packages, Do you recommend buying a bigger package? Thanks

[ Parent | on HN ]

Re:Ask HN: What are best tools for web scraping? by ajimix on Tuesday November 14, 2017 @01:15PM (#15697611)

check what I've just answered to @altareq :)

[ Parent | on HN ]