News for hackers. Stuff that matters.
Re:Show HN: Data on Shopify Stores by mritchie712 on Thursday February 04, 2021 @11:18AM (#26026723)
how'd you get the list of shopify merchants to start with?
Re:Show HN: Data on Shopify Stores by rajool on Thursday February 04, 2021 @11:42AM (#26026998)
We've extracted a list of IP addresses for shopify address (by checking whois on a relatively small number of stores we already know they're on Shopify) Then we've used some reverse whois service (like https://myip.ms) to find other domains that refer to the same IP. Those stores are definately on Shopify as their domain points to an IP address that belongs to Shopify.
Re:Show HN: Data on Shopify Stores by abusaidm on Thursday February 04, 2021 @03:03PM (#26029163)
This is really interesting. Thank you for the explanation.

I'd love to hear about how you crawl and store the data. Doesn't shopify block you as you are hitting there servers soo much for all the site?

Re:Show HN: Data on Shopify Stores by rajool on Saturday February 06, 2021 @01:27AM (#26044594)
Till now, No :)
Re:Show HN: Data on Shopify Stores by armenarmen on Thursday February 04, 2021 @11:34AM (#26026912)
Crawling all subdomain.myshopify.com I’d expect
Re:Show HN: Data on Shopify Stores by bilekas on Thursday February 04, 2021 @11:43AM (#26027009)
Isn't this limited to the guestimated subdomain ?
Re:Show HN: Data on Shopify Stores by rajool on Thursday February 04, 2021 @11:43AM (#26027007)
Reverse IP Lookup