News for hackers. Stuff that matters.
Re:Transfer files over an Ethernet patch cable by SillyUsername on Monday August 31, 2026 @04:54AM (#49507247)
You can also pipe it through zstd on the fly, for data that compresses well you'll often see 1.5 to 3× the raw throughput, so a gigabit link can effectively move 165–330MB/s.

Receiver: socat -u TCP6-LISTEN:1234,reuseaddr STDOUT | zstd -d -c | tar -xpf - -C /destination

Sender: tar -C /source -cf - directory | zstd -T0 -6 -c | socat -u STDIN 'TCP6:[fd42:dead:beef::2]:1234'

-T0 uses all cores. Bump the level above -6 for more compression, drop it for more speed, but if your CPU can't keep up, high levels will actually slow it down. Already compressed data won't see much benefit.

Re:Transfer files over an Ethernet patch cable by ElectricalUnion on Monday August 31, 2026 @07:19AM (#49508337)
If you're using specifically zstd, on the sender side, instead of tweaking the whole tunnel once, you can use --adapt to dynamically adjust to i/o conditions.
Re:Transfer files over an Ethernet patch cable by effdee on Monday August 31, 2026 @02:18PM (#49512940)
Btw, tar(1) on MacOS shows the file currently being processed when you hit Ctrl-T (i.e. when it receives SIGINFO).

And talking about signals, dd(1) can show the amount of data it has processed as well as the throughput. The signal depends on the implementation(e.g. SIGINFO for MacOS, SIGUSR1 for GNU).