Show HN: MrScraper – A visual web-scraping tool

Re:Show HN: MrScraper – A visual web-scraping tool by jarek83 on Friday February 10, 2023 @10:10AM (#34740618)

Basic question before I can recommend this to my boss: can it scrape G2? (or any other page behind CF)

[ Parent | on HN ]

Re:Show HN: MrScraper – A visual web-scraping tool by tomcam on Friday February 10, 2023 @10:30AM (#34740898)

What are G2 and CF?

[ Parent | on HN ]

Re:Show HN: MrScraper – A visual web-scraping tool by duckmysick on Friday February 10, 2023 @10:36AM (#34741000)

G2 is a software (as a service) comparison website: https://www.g2.com/

CF is Cloudflare, which offers an anti-scraping protection for websites (among other things): https://www.cloudflare.com/

[ Parent | on HN ]

Re:Show HN: MrScraper – A visual web-scraping tool by tomcam on Friday February 10, 2023 @03:06PM (#34745017)

Thank you!

[ Parent | on HN ]

Re:Show HN: MrScraper – A visual web-scraping tool by buffer_overflow on Friday February 10, 2023 @01:06PM (#34743288)

I could depending on the proxy I got from my provider. I'm currently working on adding the ability to select a higher quality proxy for difficult to scrape websites and to add captcha solvers as well.

But if I have to be honest, I can not guarantee it at the present time.

This app is the side-project I starter 2 months ago, it's evolving fast but I still need to add some key features for enterprise customers.

[ Parent | on HN ]

Re:Show HN: MrScraper – A visual web-scraping tool by jetter on Friday February 10, 2023 @01:24PM (#34743583)

scrapeninja.net /scrape-js endpoint scrapes company pages of g2 without big troubles (try us or eu proxy geo in their online sandbox: https://scrapeninja.net/scraper-sandbox )

[ Parent | on HN ]