News for hackers. Stuff that matters.

A comment on Show HN: I built a dataset of 25k+ Gumroad products to spot market opportunities. Parent comment

Re:Show HN: I built a dataset of 25k+ Gumroad products to sp... by topoftheforts on Friday September 15, 2023 @07:56AM (#37521650)
Yes just webscraping. Just used Laravel, cause that's what I'm most familiar with. The site is Laravel + AlpineJS (with Vite)
[ Parent | on HN ]
Re:Show HN: I built a dataset of 25k+ Gumroad products to sp... by AbstractAirways on Friday September 15, 2023 @08:09AM (#37521760)
I tried to scrape them and found they had some pretty robust anti-scraping implemented. Did you have to do anything to overcome it?
[ Parent | on HN ]
Re:Show HN: I built a dataset of 25k+ Gumroad products to sp... by mateuszbuda on Friday September 15, 2023 @09:04AM (#37522292)
Exactly, did you build your own solution for this, maybe based on open source projects, or do you rely on external service for scraping? I'm curious too since I'm developing a web scraping API product (https://scrapingfish.com).
[ Parent | on HN ]
Re:Show HN: I built a dataset of 25k+ Gumroad products to sp... by KomoD on Friday September 15, 2023 @10:17AM (#37523320)
What measures?
[ Parent | on HN ]