Re:Bypassing website anti-scraping protections
by mlevental on Friday June 01, 2018 @02:52PM
(#17208747)
you've misunderstood: the site used something like algolia (which the site paid for) to index. the scrapers were hitting that service (which was costing the site) rather than parsing the xml (which already had everything).
[ Parent
| on HN ]
There are no comments on this comment yet.