Show HN: I scraped 25M Shopify products to build a search engine

Re:Show HN: I scraped 25M Shopify products to build a search... by prayze on Wednesday December 13, 2023 @07:14PM (#38636128)

Did this suddenly get changed? Nothing but "# ,: # ,' | # / : # --' / # \/ />/ # /" is shown now.

[ Parent | on HN ]

Re:Show HN: I scraped 25M Shopify products to build a search... by xnx on Wednesday December 13, 2023 @07:36PM (#38636293)

Weird. I think it did change. Google cache shows a 2229 line file: https://webcache.googleusercontent.com/search?q=cache%3Ahttp...

[ Parent | on HN ]

Re:Show HN: I scraped 25M Shopify products to build a search... by capableweb on Wednesday December 13, 2023 @07:53PM (#38636419)

Seems it might be looking at the referrer. Loading https://www.shopify.com/robots.txt from clicking the link shows the weird line while opening it in a private browser window shows the right one.

[ Parent | on HN ]

Re:Show HN: I scraped 25M Shopify products to build a search... by calebegg on Wednesday December 13, 2023 @07:57PM (#38636460)

For some reason, "view source" gets the right list. Maybe a referer issue like someone else said.

[ Parent | on HN ]

Re:Show HN: I scraped 25M Shopify products to build a search... by wizzwizz4 on Wednesday December 13, 2023 @08:02PM (#38636500)

It's just your browser's HTML parser. Line 6:

  #                         / <//_\

This is being interpreted as a malformed HTML closing tag, which (according to the HTML5 parsing algorithm published by WHATWG) gets treated as a comment. The file doesn't contain any > past this point. This leaves the uncommented contents from lines 1–6:

  #                               ,:
  #                             ,' |
  #                            /   :
  #                         --'   /
  #                         \/ />/
  #                         /

Or, with whitespace collapsed:

  # ,: # ,' | # / : # --' / # \/ />/ # /

Which should be exactly what you observe.

Ref: https://html.spec.whatwg.org/multipage/parsing.html https://developer.mozilla.org/en-US/docs/Web/CSS/white-space...

[ Parent | on HN ]