Re:Downloading files from S3 with multithreading and Boto3
by haimez on Saturday April 10, 2021 @09:27PM
(#26766818)
FWIW: that 40MB single stream limit doesn’t seem to exist from my empirical measurements in the last two years. When did you work on S3?
If you're on a home internet/mobile connection downloading large files, a single download will likely saturate your connection. If you're on an EC2 instance, you should be able to do 10-100x better parallelizing.
Source: I used to work on S3.