Re:Show HN: TerabyteDeals – Compare storage prices by $/TB
by superkuh on Wednesday January 21, 2026 @05:54PM
(#46712819)
Ah, from the wording ("pull") I assumed you were using the API. You use your own user-agent to access the site(s) and collect prices then? Do you have any trouble getting blocked doing that? Is it some headless chrome controlled programatically?
[ Parent
| on HN ]
Re:Show HN: TerabyteDeals – Compare storage prices by $/TB
by vektor888 on Wednesday January 21, 2026 @06:03PM
(#46712912)
I have another site that made some qualified sales, so I can use the APIs.
I also played a bit with scraping, and you can do that quite easily, but if you want to do it at some scale, you need lots of proxies, and quite soon it gets slow and overkill