News for hackers. Stuff that matters.

A comment on Build a crawler to crawl million pages with only one machine in just 2 hours. Parent comment

Re:Build a crawler to crawl million pages with only one mach... by brianwawok on Wednesday March 01, 2017 @08:19AM (#13763428)
You can do greenlets or prefork concurrency. With prefork concurrency you get 1 process per fork. Gives you concurrency at the expense of a bit of memory.
[ Parent | on HN ]

There are no comments on this comment yet.