News for hackers. Stuff that matters.
Re:Gcloud storage: up to 94% faster data transfers for Cloud... by xani_ on Friday October 07, 2022 @09:50PM (#33129097)
how faster is rclone compared to s3cmd ? We're using s3cmd to sync some stuff for backup purpose (many many small-ish) files and performance has been generally mediocre
Re:Gcloud storage: up to 94% faster data transfers for Cloud... by tebbers on Saturday October 08, 2022 @01:48AM (#33130099)
We often have to sync hundreds of thousands of files to S3 and we use this which often hits 300 files a second on a 1Gbps link:

https://github.com/mishudark/s3-parallel-put