Re:Don't sell space in your homelab (2023)
by hfgjbcgjbvg on Sunday April 13, 2025 @02:58PM
(#43675003)
Yeah but if you’re just scraping it’s only a kb or 2 per request. Once or twice a day to check the price of an item would let you track thousands of items for years for just 8$
[ Parent
| on HN ]
Re:Don't sell space in your homelab (2023)
by bdcravens on Sunday April 13, 2025 @04:04PM
(#43675443)
Depends on the site. Some sites are sending down several megabytes of Javascript or images per request. Some sites even send down massive JSON payloads to page through instead of doing it iteratively.
Re:Don't sell space in your homelab (2023)
by hsuduebc2 on Sunday April 13, 2025 @04:47PM
(#43675734)
Exactly. Or if you decide just to scrape whole thing with headless browsers. It would be ridicilously expensive.
But I would guess this type of proxies is mostly use to send data rather than receive. You can access geo-locked sites through standard vpn.