Re:Show HN: I scraped 25M Shopify products to build a search...
by pencildiver on Wednesday December 13, 2023 @07:01PM
(#38636026)
Bought an initial list of 2m stores for a few hundred dollars from a website called "Built With". Think they are used for building sales outreach lists. Then narrowed down the focus to stores to US only and between $100k - $1m in revenue to keep the initial data set manageable (and the CPU / Storage costs reasonable).
[ Parent
| on HN ]