News for hackers. Stuff that matters.
Re:How does rsync work? by throw0101a on Saturday July 02, 2022 @12:17PM (#31960277)
> For protocol 30 and beyond (first supported in 3.0.0), the checksum used is MD5. For older protocols, the checksum used is MD4.

Newer versions (≥3.2?) support xxHash and xxHash3:

* https://github.com/WayneD/rsync/blob/master/checksum.c

* https://github.com/Cyan4973/xxHash

* https://news.ycombinator.com/item?id=19402602 (2019 XXH3 discussion)

Re:How does rsync work? by JonathonW on Saturday July 02, 2022 @10:40PM (#31964575)
As mentioned in a sibling comment, linux.die.net's manpage is outdated here (covering rsync 3.0.6). Current versions of rsync (>= 3.2.0) autonegotiate checksum type between several different options (including a few variants of xxhash, md5, and md4) unless overridden by the user, or one side is pre-3.2.0 (in which case you get the old behavior with MD5 or MD4 depending on protocol version). The pre-transfer and transfer checksums also don't necessarily have to be the same (I don't particularly care to hunt down the default priority lists right now, so I'm not sure if they are the same or not by default).

Manpage for rsync 3.2.4, from Debian testing: https://manpages.debian.org/testing/rsync/rsync.1.en.html

Re:How does rsync work? by hinkley on Saturday July 02, 2022 @08:24PM (#31963820)
I was surprised to learn recently that sha1 is typically about 10% faster than md5. I have some coworkers who I need to remind of this, since they’re still using md5 for caching.
Re:How does rsync work? by yencabulator on Saturday July 02, 2022 @11:41PM (#31964848)
And Blake3 is almost 7 times faster than SHA-1...
Re:How does rsync work? by aidenn0 on Saturday July 02, 2022 @02:36PM (#31961269)
I thought xxHash was only used for the chunk hash, not the whole file hash?