News for hackers. Stuff that matters.
Re:Scrapingworld.com – Scraping Directory: components, provi... by varenc on Monday July 06, 2020 @03:35AM (#23745567)
Interesting collection of resources.

I found the residential IP proxy services a bit eyebrow raising. This one, https://luminati.io/ethical, apparently gets their residential IPs by having app developers embed the Luminati SDK. So when you use their proxy network, your request will be routed through some oblivious person’s phone or laptop. I assume that the requests can’t be end to end encrypted and that whatever user whose device is making the request will be able to see it.

While there’s certainly some legitimate and even noble uses of residential IP proxies, I can think of plenty nefarious ones too. Must be a constant challenge for this company to combat that. If they do.

Re:Scrapingworld.com – Scraping Directory: components, provi... by kaltsturm on Monday July 06, 2020 @05:10AM (#23746010)
Thank you for sharing your insights - indeed. If residential proxies are needed for scraping, we shall keep your insights in mind.
Re:Scrapingworld.com – Scraping Directory: components, provi... by hombre_fatal on Monday July 06, 2020 @03:32AM (#23745554)
If you're going to start a directory, why wouldn't you do the research to seed it with elementary content? Your only info link is a wikipedia link about scraping and you're hoping people email you with more links.

Seems a bit bizarre to me.

Re:Scrapingworld.com – Scraping Directory: components, provi... by kaltsturm on Monday July 06, 2020 @04:58AM (#23745942)
You are right - we just wanted to kickstart and will work on our own for sure to add more content. What are your top links with respect to scraping?
Re:Scrapingworld.com – Scraping Directory: components, provi... by deaquino on Monday July 06, 2020 @03:30AM (#23745545)
Chrome Extension: https://www.webscraper.io/
Re:Scrapingworld.com – Scraping Directory: components, provi... by kaltsturm on Monday July 06, 2020 @05:02AM (#23745962)
added
Re:Scrapingworld.com – Scraping Directory: components, provi... by kaltsturm on Tuesday July 07, 2020 @01:01AM (#23755845)
Do you know of any site-specific scraping services, e.g. eBay, Google, ... ?
Re:Scrapingworld.com – Scraping Directory: components, provi... by kaltsturm on Monday July 06, 2020 @03:05AM (#23745424)
If you miss functionality - not content - on scrapingworld.com, please comment here.
Re:Scrapingworld.com – Scraping Directory: components, provi... by kaltsturm on Monday July 06, 2020 @03:03AM (#23745413)
If you miss best in class links for - providers - knowledge posts - components

please comment here - we will add them on scrapingworld.com

Re:Scrapingworld.com – Scraping Directory: components, provi... by elxavicio on Monday July 06, 2020 @03:29AM (#23745541)
Check out proxyland.io!
Re:Scrapingworld.com – Scraping Directory: components, provi... by kaltsturm on Monday July 06, 2020 @05:01AM (#23745960)
added
Re:Scrapingworld.com – Scraping Directory: components, provi... by bhargavdigi on Monday July 06, 2020 @03:46AM (#23745613)
nice thanks for sharing us