Re:Storing large binary files in Git repositories (2015)
by petertodd on Tuesday March 08, 2016 @02:16PM
(#11247725)
Have you considered using the copy-on-write features that some filesystems (btrfs) now support? For example, the lowly cp command now supports CoW via --reflink=always
Also, that ks for git-annex! I use it for hundreds of gigabytes of files, and find the one-copy-per-file support essential for how I use it.
Re:Storing large binary files in Git repositories (2015)
by drdaeman on Tuesday March 08, 2016 @01:49PM
(#11247482)
Whoa, this looks great!
Sorry for possible off-topic, but I wonder if anyone knows a way to convert/upgrade older (created an year ago) git-annex repo to a newer v6 one?
Re:Storing large binary files in Git repositories (2015)
by sk3w on Wednesday March 09, 2016 @04:12PM
(#11255764)
https://git-annex.branchable.com/upgrades/#index1h2
I haven't tried this yet myself.
Also, it's worth noting that git-lfs stores 2 copies of each large file on local disk. git-annex stores 1 copy. Which is a pretty big plus the article left out.