News for hackers. Stuff that matters.
Re:Decreasing Gitlab repo backup times from 48 hours to 41 m... by SoftTalker on Friday June 06, 2025 @02:27PM (#44203633)
Cool discovery but the article could have been about 1/10 as long and still communicated effectively. At least they didn't post it as a video, so it was easy to skim to the important details.
Re:Decreasing Gitlab repo backup times from 48 hours to 41 m... by kokada on Friday June 06, 2025 @04:40PM (#44204753)
Yes. I read the whole article thinking that this must have been generated by LLM, because at least the style remembers it.
Re:Decreasing Gitlab repo backup times from 48 hours to 41 m... by ruuda on Friday June 06, 2025 @06:24PM (#44205614)
That was also my thought.
Re:Decreasing Gitlab repo backup times from 48 hours to 41 m... by Scaevolus on Friday June 06, 2025 @11:23PM (#44207167)
Em dashes and bullet points!
Re:Decreasing Gitlab repo backup times from 48 hours to 41 m... by jaygreco on Saturday June 07, 2025 @12:44AM (#44207501)
Glad I wasn’t the only one who thought this. The post is also missing one obvious thing that I expect in any technical post: code snippets. Let me see the code.

ChatGPT has ruined bullet points for the rest of us…

No offense but writing this blog post couldn’t take more than a few minutes, why spoil it with LLM? Shoot, use one to check grammar and recommend edits even.

Re:Decreasing Gitlab repo backup times from 48 hours to 41 m... by bearjaws on Saturday June 07, 2025 @09:25AM (#44209514)
Don't take my bullet points away from me
Re:Decreasing Gitlab repo backup times from 48 hours to 41 m... by jorvi on Saturday June 07, 2025 @09:55AM (#44209680)
They came for the em dashes, and I did not speak up. Then they came for the bullet points, and I did not speak up..
Re:Decreasing Gitlab repo backup times from 48 hours to 41 m... by djdeutschebahn on Saturday June 07, 2025 @10:37AM (#44209924)
Exactly thought the same. Reading experience of the post would have been definitely improved, with less text.
Re:Decreasing Gitlab repo backup times from 48 hours to 41 m... by 1oooqooq on Friday June 06, 2025 @05:33PM (#44205198)
it could have been longer. I still don't know why they were doing backup bundles with two refs :)
Re:Decreasing Gitlab repo backup times from 48 hours to 41 m... by 6LLvveMx2koXfwn on Friday June 06, 2025 @11:22PM (#44207162)
They weren't, if you look at the fix [1] the dedupe loop was run in all cases, not just those with known dupes, so the performance hit was any bundle with lots of refs.

1.https://github.com/git/git/commit/bb74c0abbc31da35be52999569...

Re:Decreasing Gitlab repo backup times from 48 hours to 41 m... by rjmunro on Saturday June 07, 2025 @02:21PM (#44211490)
But why couldn't they just dedupe the refs from the command line before starting the actual bundling - surely there are never more than a couple of hundred of those (one per branch)?
Re:Decreasing Gitlab repo backup times from 48 hours to 41 m... by 6LLvveMx2koXfwn on Sunday June 08, 2025 @10:14AM (#44217157)
The point is the performance hit had nothing to do with dupe count (which could be zero), and everything to do with ref count.
Re:Decreasing Gitlab repo backup times from 48 hours to 41 m... by nayak on Monday June 09, 2025 @04:28AM (#44222445)
Spot on. Some of our repositories at GitLab can contain millions of references.
Re:Decreasing Gitlab repo backup times from 48 hours to 41 m... by davidron on Friday June 06, 2025 @08:21PM (#44206353)
For those that haven't read the article yet, scroll down to the flame graph and start reading unit it starts talking about back porting the fix. Then stop.
Re:Decreasing Gitlab repo backup times from 48 hours to 41 m... by wgjordan on Friday June 06, 2025 @10:43PM (#44206996)
"How we decreased reading 'How we decreased GitLab repo backup times from 48 hours to 41 minutes' times from 4.8 minutes to 41 seconds"
Re:Decreasing Gitlab repo backup times from 48 hours to 41 m... by hliyan on Saturday June 07, 2025 @10:50AM (#44210034)
Interesting that multiple people are noticing this same thing. For me, this could have been:

"We found that a large portion of the 48 hours taken to backup our rails respository was due to a function in `git bundle create` that checks for duplicate references entered as command line arguments. The check contained a nested for loop ( O(N2) ), which we replaced with a map data structure in an upstream fix to Git. The patch was accepted, but we also backported fix without waiting for the next Git version. With this change, backup time dropped to 41 minutes."

Re:Decreasing Gitlab repo backup times from 48 hours to 41 m... by m104 on Saturday June 07, 2025 @03:44PM (#44212091)
It's the "impact" style of technical write-ups: sell the problem and the scale, then present the solution, which is thus presented and understood through the lens of business and customer success.

Generously, this writing style is supposed to show the business value of teams and individuals, for promotions or other recognition. But yeah, it can be frustrating to read this style.