News for hackers. Stuff that matters.
Re:Ask HN: What is your favorite method of sending large files? by unilynx on Wednesday September 02, 2020 @04:38PM (#24357855)
This is especially fun when combined with piping through tar, and adding pv in the mix for a transfer speed "progress" bar.

Fastest way to transfer a collection of files on a local network and doesn't require temporary storage for the archive

Re:Ask HN: What is your favorite method of sending large files? by enriquto on Wednesday September 02, 2020 @05:37PM (#24358452)
piping through tar is my "power move" when I want to steer a new recruit. I just do it casually in front of them... depending on whether they are awed or horrified by that, they'll get more hacky or more formal work.
Re:Ask HN: What is your favorite method of sending large files? by parliament32 on Wednesday September 02, 2020 @05:43PM (#24358517)
You can also pipe through gpg if you want encryption along the way!
Re:Ask HN: What is your favorite method of sending large files? by ahsima1 on Wednesday September 02, 2020 @05:51PM (#24358590)
And through gzip/zstd/etc if you want compression!
Re:Ask HN: What is your favorite method of sending large files? by 3np on Thursday September 03, 2020 @02:19AM (#24361238)
And through tac if you want it in reverse!

(...And my axe!)

Re:Ask HN: What is your favorite method of sending large files? by labawi on Friday September 04, 2020 @01:53PM (#24377261)
Note that gpg compresses by default. Which is thy it's so slow. You may wish to use lzop or zstd but also disable gpg's compression.

I usually use ssh (e.g. ssh -L 3333:localhost:3333) and avoid gpg, though I may use lzop depending on link and CPU speed.

Re:Ask HN: What is your favorite method of sending large files? by enriquto on Wednesday September 02, 2020 @05:58PM (#24358656)
that's what the -C option to ssh is for
Re:Ask HN: What is your favorite method of sending large files? by cellularmitosis on Wednesday September 02, 2020 @06:21PM (#24358881)
lzop if you gotta go fast :)
Re:Ask HN: What is your favorite method of sending large files? by namibj on Thursday September 03, 2020 @03:40AM (#24361683)
zstd easily outruns a gigabit link on most somewhat-compressible data.
Re:Ask HN: What is your favorite method of sending large files? by kortex on Wednesday September 02, 2020 @10:26PM (#24360304)
What's an example of the syntax of this? I remember seeing a graybeard do something like this to huck some files to another machine.
Re:Ask HN: What is your favorite method of sending large files? by waterhouse on Thursday September 03, 2020 @09:41AM (#24363929)
Paraphrased from a real example:

  tar cf - files morefiles | ssh user@dest "tar xf -"
If you want to insert, say, compression:

  tar cf - files morefiles | zstd | ssh user@dest "zstd -d | tar xf -"
Re:Ask HN: What is your favorite method of sending large files? by ashton314 on Thursday September 03, 2020 @01:28PM (#24366397)
Nice. This to me is a great testament of the power of the Unix philosophy: small orthogonal tools that operate on streams of text.