News for hackers. Stuff that matters.

A comment on Show HN: I scraped 25M Shopify products to build a search engine. Parent comment

Re:Show HN: I scraped 25M Shopify products to build a search... by xnx on Wednesday December 13, 2023 @07:36PM (#38636293)
Weird. I think it did change. Google cache shows a 2229 line file: https://webcache.googleusercontent.com/search?q=cache%3Ahttp...
[ Parent | on HN ]
Re:Show HN: I scraped 25M Shopify products to build a search... by capableweb on Wednesday December 13, 2023 @07:53PM (#38636419)
Seems it might be looking at the referrer. Loading https://www.shopify.com/robots.txt from clicking the link shows the weird line while opening it in a private browser window shows the right one.
[ Parent | on HN ]