News for hackers. Stuff that matters.

A comment on Show HN: I scraped 25M Shopify products to build a search engine.

Re:Show HN: I scraped 25M Shopify products to build a search... by ttt3ts on Wednesday December 13, 2023 @08:16PM (#38636600)
Built the same thing a while back while collecting a lead list for sales. Not bothered to keep data updated but was a fun thing to build in a couple days. (disclaimer mobile experience is meh cause it was a fun project)

https://zensear.ch

How did you find list of all Shopify stores? I ended up just checking every .com, .net, etc as I didn't find an easy way to figure it out directly from shopify.

[ Parent | on HN ]
Re:Show HN: I scraped 25M Shopify products to build a search... by 8372049 on Wednesday December 13, 2023 @08:43PM (#38636789)
In another comment, OP writes:

> Bought an initial list of 2m stores for a few hundred dollars from a website called "Built With". Think they are used for building sales outreach lists. Then narrowed down the focus to stores to US only and between $100k - $1m in revenue to keep the initial data set manageable (and the CPU / Storage costs reasonable).

[ Parent | on HN ]
Re:Show HN: I scraped 25M Shopify products to build a search... by slimebot80 on Thursday December 14, 2023 @01:15AM (#38638383)
Nice. But can I ask what motivated you? I don't see any affiliate details in the links - do you monetise at all?
[ Parent | on HN ]
Re:Show HN: I scraped 25M Shopify products to build a search... by ttt3ts on Thursday December 14, 2023 @09:02AM (#38641399)
Wanted to play with typesense.

The tech behind building something like this isn't hard. Marketing and traffic is. No point in monetizing with no users.

[ Parent | on HN ]
Re:Show HN: I scraped 25M Shopify products to build a search... by alvarome on Thursday December 14, 2023 @09:50AM (#38641940)
It looks like from the "become a merchant" you can directly boost your products which I assume will prioritize them and hence drive more traffic to your Shopify store
[ Parent | on HN ]