Re:Ask HN: What is your favorite method of sending large files?
by akerro on Wednesday September 02, 2020 @03:29PM
(#24356985)
>I'm also curious on how you'd send 10TB or more.
For my 12TiB of data I use Syncthing when I need to sync them more often, rsync.
I used rsync several times for billions of smaller files totalling to 300GiB, but really all depending on how I connect nodes. I prefer syncthing, but when only ssh is available, then rsync is good too.
Currently largest synced directory by syncthing (that shares usage stats) is over 61384 GiB :)) https://data.syncthing.net/
For my 12TiB of data I use Syncthing when I need to sync them more often, rsync.
I used rsync several times for billions of smaller files totalling to 300GiB, but really all depending on how I connect nodes. I prefer syncthing, but when only ssh is available, then rsync is good too.
Currently largest synced directory by syncthing (that shares usage stats) is over 61384 GiB :)) https://data.syncthing.net/