News for hackers. Stuff that matters.

A comment on An Update on the scraper situation. Parent comment

Re:An Update on the scraper situation by binarymax on Friday July 10, 2026 @10:23PM (#48868005)
It’s not that hard. I’ve done this. The list of URLs for a crawl is several hundred gigs. Easily fits in a lookup index on a single instance.
[ Parent | on HN ]

There are no comments on this comment yet.