News for hackers. Stuff that matters.
Re:How to crawl a quarter billion webpages in 40 hours (2012) by bryanrasmussen on Thursday June 15, 2023 @05:14AM (#36338048)
don't want to release the source code because of moral reservations about how people might use it. Ok upstanding citizen.
Re:How to crawl a quarter billion webpages in 40 hours (2012) by EGreg on Thursday June 15, 2023 @05:23AM (#36338109)
Just like AI people