News for hackers. Stuff that matters.
Re:Downloading files from S3 with multithreading and Boto3 by Galanwe on Saturday April 10, 2021 @09:57PM (#26766926)
Using multiprocessing I've been able to quite easily saturate a 20GBps Ec2 NICs in python. https://github.com/NewbiZ/s3pd

There is no reason why multiprocessing for IO in python would use _crazily_ more memory than in an other language, when done properly.

There are no comments on this comment yet.