Re:Two Upstart Search Engines Are Teaming Up to Take on Google
by immibis on Wednesday November 13, 2024 @12:55AM
(#42123302)
Note that due to adversarial interoperability, search engines other than Google can scrape Reddit if they try hard enough. A rotating residential proxy subscription, while pricey, likely still costs orders of magnitude less than what Google paid. The same goes for Stack Overflow. You can also DIY by getting a handful of SIM cards. CGNAT, usually a scourge, works in your favour for this application since Reddit can't tell the difference between you loading 10000 pages and 10000 people on your ISP loading one page each (depending on the ISP)
[ Parent
| on HN ]
There are no comments on this comment yet.