News for hackers. Stuff that matters.
Re:SCP – Familiar, Simple, Insecure, and Slow by aidenn0 on Friday June 19, 2020 @07:58PM (#23580183)
For a long time I have just piped tar over ssh. For lots of small files, it's faster than an rsync to an empty directory. It can also sync anything that the tar on both sides can handle. I wrote a script for doing this for my coworkers who identify with https://xkcd.com/1168/
Re:SCP – Familiar, Simple, Insecure, and Slow by jerf on Friday June 19, 2020 @08:55PM (#23580544)
One thing I like about this solution is fine-grained control over the compression. I've used xz on a slow connection to the other side of the world, I've used no compression on super fast connections. You get whatever you want.
Re:SCP – Familiar, Simple, Insecure, and Slow by aidenn0 on Friday June 19, 2020 @11:01PM (#23581185)
Indeed! Unless it's a wired LAN connection, zstd will not make things slower on lower settings, and can make it faster
Re:SCP – Familiar, Simple, Insecure, and Slow by sroussey on Friday June 19, 2020 @09:41PM (#23580777)
I pipe tar over nc if encryption does not matter.
Re:SCP – Familiar, Simple, Insecure, and Slow by aidenn0 on Friday June 19, 2020 @10:59PM (#23581181)
I use ssh because it's easier to use than nc, and there are very few hosts with encryption performance slower than network performance. On a 10g line it might matter, but gigabit or usually doesn't.
Re:SCP – Familiar, Simple, Insecure, and Slow by Hello71 on Friday June 19, 2020 @11:02PM (#23581194)
assuming you only use unloaded servers with hardware a accelerated AES.
Re:SCP – Familiar, Simple, Insecure, and Slow by aidenn0 on Saturday June 20, 2020 @06:16PM (#23587854)
I can saturate a GigE line with a 10 year old NAS. Not sure if it has HW accelerated AES or not.