News for hackers. Stuff that matters.

A comment on Memory efficiency of parallel IO operations in Python.

Re:Memory efficiency of parallel IO operations in Python by blattimwind on Tuesday March 13, 2018 @07:52AM (#16575359)
tl;dr

If you want to parallelize[1] network I/O, use async. Otherwise, don't.

[1] Technically: not parallelize, but overlap.

[ Parent | on HN ]
Re:Memory efficiency of parallel IO operations in Python by icegreentea2 on Tuesday March 13, 2018 @10:02AM (#16576143)
Well, it's use async if you need the ~40% decrease in ram usage for your concurrent I/O access.
[ Parent | on HN ]
Re:Memory efficiency of parallel IO operations in Python by nullp0tr on Tuesday March 13, 2018 @08:54AM (#16575697)
Concurrent is the technical term:)
[ Parent | on HN ]
Re:Memory efficiency of parallel IO operations in Python by blattimwind on Tuesday March 13, 2018 @09:10AM (#16575786)
Overlapping is a technical term, too, just not from the Unix world.
[ Parent | on HN ]
Re:Memory efficiency of parallel IO operations in Python by xapata on Tuesday March 13, 2018 @01:01PM (#16577592)
Very few of my networking projects risk running out of RAM. I'm usually fine with spawning a new thread per connection.
[ Parent | on HN ]