News for hackers. Stuff that matters.
Re:Show HN: We scaled Git to support 1 TB repos by substation13 on Tuesday December 13, 2022 @10:46AM (#33970361)
Versioning data is great, but storing as diffs is inefficient when 99% of the file changes each version.
Re:Show HN: We scaled Git to support 1 TB repos by reverius42 on Tuesday December 13, 2022 @10:48AM (#33970415)
We don't store as diffs, we store as snapshots -- and it's efficient thanks to the way we do dedupe. See https://xethub.com/assets/docs/how-xet-deduplication-works/