We Put Half a Million Files in One Git Repository, Here's What We Learned (2022)

Re:We Put Half a Million Files in One Git Repository, Here's... by maccard on Monday August 28, 2023 @08:01AM (#37292732)

Git LFS isn't the same as git, though. It's better than putting everything in a separate store, but for one it disables offline work, and breaks the concept of D in the DVCS of git.

> then have your build toolchain unzip the archive before it runs

My build toolchain shouldn't have to work around the shortcomings of my environment, IMO.

> et voila you now have this large file versioned in Git.

No, it's on a separate http server that is fetched via git lfs. Subtle, but important difference.

[ Parent | on HN ]

Re:We Put Half a Million Files in One Git Repository, Here's... by aidenn0 on Monday August 28, 2023 @01:00PM (#37297181)

> it disables offline work,

This is a non-issue for images and autogenerated files, since you shouldn't ever be doing a merge on them.

> breaks the concept of D in the DVCS of git.

git-annex is distributed and works well for files that will never be merged (such as images, or autogenerated files)

[ Parent | on HN ]