News for hackers. Stuff that matters.
Re:Show HN: I scraped 25M Shopify products to build a search... by berkes on Thursday December 14, 2023 @03:53AM (#38639266)
Unfortunately many of these "comparison" websites have a businesses model built on affiliate fees.

It doesn't take much imagination to predict which products show up as "best" or "cheapest".

And the fairer ones have to keep playing cat and mouse with shops lowering pricing when they detect a scraper coming by. Or employ tricks to make their shipping seem free, lowering their overall price on the comparison platform.

Re:Show HN: I scraped 25M Shopify products to build a search... by Semaphor on Thursday December 14, 2023 @04:16AM (#38639405)
> It doesn't take much imagination to predict which products show up as "best" or "cheapest".

Never seen a "best" outside of amazon, which does weird shit even without any affiliate fees. And "cheapest" is not really up to the site, unless they want to go under quite quickly.

Re:Show HN: I scraped 25M Shopify products to build a search... by zo1 on Thursday December 14, 2023 @04:44AM (#38639561)
Many if not all are like that. It's like everyone wants to take advantage of the lack of perfect information in the marketplace, as opposed to actually being helpful for consumers.