News for hackers. Stuff that matters.
Re:Show HN: I scraped 25M Shopify products to build a search... by Ninjinka on Wednesday December 13, 2023 @08:08PM (#38636538)
As someone who has scraped millions of items myself, I had success using Geziyor (https://github.com/geziyor/geziyor) built in Go. Shopify sites are especially easy to scrape because they tend to share the same product data formatting and don't hide it behind JS rendering.

There are no comments on this comment yet.