Re:Ask HN: What is your favorite method of sending large files?
by enriquto on Wednesday September 02, 2020 @05:37PM
(#24358452)
piping through tar is my "power move" when I want to steer a new recruit. I just do it casually in front of them... depending on whether they are awed or horrified by that, they'll get more hacky or more formal work.
Re:Ask HN: What is your favorite method of sending large files?
by parliament32 on Wednesday September 02, 2020 @05:43PM
(#24358517)
You can also pipe through gpg if you want encryption along the way!
Re:Ask HN: What is your favorite method of sending large files?
by ahsima1 on Wednesday September 02, 2020 @05:51PM
(#24358590)
And through gzip/zstd/etc if you want compression!
Re:Ask HN: What is your favorite method of sending large files?
by 3np on Thursday September 03, 2020 @02:19AM
(#24361238)
And through tac if you want it in reverse!
(...And my axe!)
Re:Ask HN: What is your favorite method of sending large files?
by labawi on Friday September 04, 2020 @01:53PM
(#24377261)
Note that gpg compresses by default. Which is thy it's so slow. You may wish to use lzop or zstd but also disable gpg's compression.
I usually use ssh (e.g. ssh -L 3333:localhost:3333) and avoid gpg, though I may use lzop depending on link and CPU speed.
Re:Ask HN: What is your favorite method of sending large files?
by enriquto on Wednesday September 02, 2020 @05:58PM
(#24358656)
that's what the -C option to ssh is for
Re:Ask HN: What is your favorite method of sending large files?
by cellularmitosis on Wednesday September 02, 2020 @06:21PM
(#24358881)
lzop if you gotta go fast :)
Re:Ask HN: What is your favorite method of sending large files?
by namibj on Thursday September 03, 2020 @03:40AM
(#24361683)
zstd easily outruns a gigabit link on most somewhat-compressible data.
Re:Ask HN: What is your favorite method of sending large files?
by kortex on Wednesday September 02, 2020 @10:26PM
(#24360304)
What's an example of the syntax of this? I remember seeing a graybeard do something like this to huck some files to another machine.
Re:Ask HN: What is your favorite method of sending large files?
by waterhouse on Thursday September 03, 2020 @09:41AM
(#24363929)
Paraphrased from a real example:
tar cf - files morefiles | ssh user@dest "tar xf -"
If you want to insert, say, compression: tar cf - files morefiles | zstd | ssh user@dest "zstd -d | tar xf -"
Fastest way to transfer a collection of files on a local network and doesn't require temporary storage for the archive