Re:Show HN: I scraped 25M Shopify products to build a search...
by Ninjinka on Wednesday December 13, 2023 @08:08PM
(#38636538)
As someone who has scraped millions of items myself, I had success using Geziyor (https://github.com/geziyor/geziyor) built in Go. Shopify sites are especially easy to scrape because they tend to share the same product data formatting and don't hide it behind JS rendering.
[ Parent
| on HN ]
There are no comments on this comment yet.