News for hackers. Stuff that matters.
Re:Uncovering a 24-year-old bug in the Linux Kernel by rancor on Thursday February 11, 2021 @01:20PM (#26105159)
I have, admittedly old and very vague, memories of people talking about rsync being "hard on networks" or "dealing poorly with congestion." I'd put good odds that this bug is why those statements existed.
Re:Uncovering a 24-year-old bug in the Linux Kernel by jandrese on Thursday February 11, 2021 @03:56PM (#26107042)
This seems to be the opposite. You only see it when transferring titanic amounts of data over a pristine connection. If your network had congestion you wouldn't trigger this bug.

But this also explains a bit why rsync is "hard on networks". Most bulk data transfers end up with breaks in the data that give more breathing room to other protocols. Not rsync, it tries as hard as it can to keep the pipe full 100% of the time, making it hard for other TCP slow starters to get a foothold.

Re:Uncovering a 24-year-old bug in the Linux Kernel by tinus_hn on Thursday February 11, 2021 @05:16PM (#26108132)
BitTorrent does the same thing and used to be a lot more common, just typically not between hosts close to each other.
Re:Uncovering a 24-year-old bug in the Linux Kernel by M2Ys4U on Friday February 12, 2021 @06:03AM (#26112374)
TCP-based bittorrent, yes.

The uTP protocol (which has an IETF version called LEDBAT) was specifically designed to be used for background transmission, and it should slow itself down if there are competing TCP flows.

Re:Uncovering a 24-year-old bug in the Linux Kernel by Dylan16807 on Friday February 12, 2021 @01:21AM (#26111198)
One big fat TCP connection isn't so bad on networks. Especially the default behavior of slowly creeping up in speed until it loses a packet, then dropping back down.

As I understand it significant factor in getting this bug to happen is that you're sending tons of data but in a way that's limited by the source.

Re:Uncovering a 24-year-old bug in the Linux Kernel by breatheoften on Thursday February 11, 2021 @09:12PM (#26110057)
rsync is hard on networks???????????

Is there any truth to this? I find it hard to believe -- most of the time rsync is tunneled over ssh which seems well enough abstracted from an optimal traffic generation mechanism that i would seriously doubt it's able to outcompete other programs for network resources in a meaningful way ... perhaps this observation evolved because there are a lot of networks that have traffic shaping rules for ssh? unfortunate effects of traffic shaping rules for ssh + low bandwidth connection + rsyncs happening over ssh + an administrator logged into an ssh port via the low bandwidth link

could maybe produce this observed (but non-sensical?) correlation?

Re:Uncovering a 24-year-old bug in the Linux Kernel by bonzini on Thursday February 11, 2021 @02:33PM (#26106029)
The bug requires transferring over 2GB of data without reading from the socket, so it's unlikely; also, a hang is the opposite of being hard on the network. ;) However the uncommon characteristics of rsync traffic is probably why some congestion control algorithms may not deal well with rsync.