Re:Downloading files from S3 with multithreading and Boto3
by ben509 on Saturday April 10, 2021 @10:45PM
(#26767123)
That issue is just botocore not supporting async, which aiobotocore addresses. It's also very long; is there a particular comment on that issue that you wanted to point out?
[ Parent
| on HN ]
Re:Downloading files from S3 with multithreading and Boto3
by emasquil on Sunday April 11, 2021 @01:45PM
(#26772060)
I just mentioned the issue because a colleague of mine did some quick tests with aioboto3 and he told me it was downloading the files sequentially. We thought it might be related to that.
You made a great point about going async if you need a working command channel.