Channel3 (YC S25) – A database of every product on the internet

Re:Channel3 (YC S25) – A database of every product on the in... by blancotech on Wednesday August 20, 2025 @05:16PM (#44966567)

Curious, how are you keeping the product data up-to-date? We built something similar for price alerts on specific URLs, that we use all the time, but have to poll it daily to see the price change (https://lowlow.bot). I imagine that would be a lot of $$ for every product on the Internet.

[ Parent | on HN ]

Re:Channel3 (YC S25) – A database of every product on the in... by glawrence13 on Wednesday August 20, 2025 @05:35PM (#44966746)

This is definitely one of our hard problems. There are some optimizations -- e-tags / last modified headers, comparing page content hashes -- but there's also only so much you can do before you just have to check the page again.

[ Parent | on HN ]

Re:Channel3 (YC S25) – A database of every product on the in... by AznHisoka on Thursday August 21, 2025 @03:34PM (#44977054)

Last modified headers is always set to the current time in the majority of cases, and it also requires a web request too (albeit a HEAD request would likely suffice)

[ Parent | on HN ]