Re:SCP – Familiar, Simple, Insecure, and Slow
by aidenn0 on Friday June 19, 2020 @07:58PM
(#23580183)
For a long time I have just piped tar over ssh. For lots of small files, it's faster than an rsync to an empty directory. It can also sync anything that the tar on both sides can handle. I wrote a script for doing this for my coworkers who identify with https://xkcd.com/1168/
[ Parent
| on HN ]
One thing I like about this solution is fine-grained control over the compression. I've used xz on a slow connection to the other side of the world, I've used no compression on super fast connections. You get whatever you want.
Re:SCP – Familiar, Simple, Insecure, and Slow
by aidenn0 on Friday June 19, 2020 @11:01PM
(#23581185)
Indeed! Unless it's a wired LAN connection, zstd will not make things slower on lower settings, and can make it faster
Re:SCP – Familiar, Simple, Insecure, and Slow
by sroussey on Friday June 19, 2020 @09:41PM
(#23580777)
I pipe tar over nc if encryption does not matter.
Re:SCP – Familiar, Simple, Insecure, and Slow
by aidenn0 on Friday June 19, 2020 @10:59PM
(#23581181)
I use ssh because it's easier to use than nc, and there are very few hosts with encryption performance slower than network performance. On a 10g line it might matter, but gigabit or usually doesn't.