News for hackers. Stuff that matters.
Re:Scaling Mercurial at Facebook (2014) by liveoneggs on Saturday September 12, 2020 @03:58PM (#24455097)
I can only imagine an attempt at the initial clone.. the hg client is ridiculously slow, memory-hungry, and full of dumb behavior that seems to assume local connections
Re:Scaling Mercurial at Facebook (2014) by est31 on Saturday September 12, 2020 @04:13PM (#24455233)
hg has a mode to make initial clones faster by offering zipped compressed checkouts for download.
Re:Scaling Mercurial at Facebook (2014) by liveoneggs on Sunday September 13, 2020 @08:10AM (#24460306)
it does range requests to these bundles, attempts to extract the partials while keeping the http connection alive using up GB of memory in the process, and then totally fails pretty regularly when it need to go back to the network. It makes no attempt at recovering those chunks, re-establishing connections, or using any intelligence at all.

It also overwhelms http header size norms on the regular and runs up memory when attempting to use those bundles.

Chunks/bundles are, in fact, strictly worse unless you get your initial clones with a good piece of software like curl.