News for hackers. Stuff that matters.
Re:Moving 25TB data from one S3 bucket to another took 7 eng... by oarsinsync on Monday September 14, 2020 @01:39AM (#24467130)
rclone lets you specify how many files to handle in parallel. It defaults to 4, and auto retries in the event of failures.

Ramp up the parallelism, and don’t make 7 people monitor it round the clock.

There are no comments on this comment yet.