Re:Build a crawler to crawl million pages with only one mach...
by plantpark on Tuesday February 28, 2017 @10:24PM
(#13760770)
Sorry for that incomplete description in my article. Because of GIL of python, python application could not make full use of machines. Of course, some libraries like gevent/asyncio could fix it well. I will have a test to find out which one is the best, include docker.
Thanks for your comment.