News for hackers. Stuff that matters.
Re:How to Handle Big Git Repositories by yeukhon on Thursday March 12, 2015 @08:04PM (#9194875)
submodules is a curse IMO. I used submodules in the pass and I hate it. Some of our projects still use submodules and I am vocal about removing the reference. My reason disliking it is that 1) I always forget to do recursive, 2) I hate to muddle my root repository with another repository inside of it, 3) I forget to update the commit, and 4) most of the time I don't need submodules. I can live with more git clone commands. Oh add one more - a lot of people use git@ rather than https:// because I don't use SSH to clone (I enable two-auth however) on my laptop, so whenever I clone one of our org's project which has sudmodule, I have to fix sudmodule config....

Personally I really dislike the fact Ansible's plugins are now sudmodules, but not up to me to decide.

The only large repo I have worked with was Firefox (mozilla-central) but I use Mercurial. Either way the speed was never an issue for me for a fresh clone - I expect a while. In git I could clone specific branch or specify a depth if I know I just need specific branch to work with. I guess when you work with real big repo like Facebook's or Google, then maybe there is a concern.

Re:How to Handle Big Git Repositories by sytse on Thursday March 12, 2015 @08:13PM (#9194915)
Git Annex is a great way to handle large files. You can version them with git but they don't make the repository larger. And they are synced at rsync speeds. GitLab.com and GitLab EE have build in support for it https://about.gitlab.com/2015/02/17/gitlab-annex-solves-the-...
Re:How to Handle Big Git Repositories by res0nat0r on Thursday March 12, 2015 @07:27PM (#9194718)
BFG Repo Cleaner is also a good tool which I don't see mentioned in the article: https://rtyley.github.io/bfg-repo-cleaner/
Re:How to Handle Big Git Repositories by e40 on Friday March 13, 2015 @02:22PM (#9198864)
This looks very interesting, but I'm a little nervous about it since it would appear it operates directly on the repo internal files.

Anything you can say to make me feel better about using it?

Re:How to Handle Big Git Repositories by robertotyley on Friday March 13, 2015 @05:37PM (#9200248)
I'm the author of the BFG, I'll try to help with that.

The BFG uses the JGit library to act on Git repository internals - JGit's the library used by Google for hosting the Android codebase, handling thousands of commits a day, and it's basically a pretty serious library. As for the BFG itself, I've used it myself on several critical repositories at the Guardian, and it's been used on many major projects around the world - here's a hundred tweets by different people who've used the BFG:

https://twitter.com/rtyley/timelines/464727264345993216

...and here's a comment by the head maintainer of Git itself, Junio Hamano:

https://plus.google.com/+JunioCHamano/posts/Lm7iBwSLvoo

So, I guess, most people like it.

Re:How to Handle Big Git Repositories by jerf on Sunday March 15, 2015 @02:53PM (#9207566)
In addition to the other reply, git is a distributed version control system. You can trivially run it on a copy of your repo and put it through whatever tests you like.
Re:How to Handle Big Git Repositories by m0th87 on Thursday March 12, 2015 @11:30PM (#9195534)
We made git fit to manage big assets as well: https://github.com/dailymuse/git-fit

Didn't go with git annex because, frankly, I never felt like I grasped what was going on in the background when using it.

Re:How to Handle Big Git Repositories by shurcooL on Thursday March 12, 2015 @10:48PM (#9195450)
Someone should show this article to Jonathan Blow.
Re:How to Handle Big Git Repositories by aikinai on Friday March 13, 2015 @01:09AM (#9195744)
Does anyone know if mainline git has any plans to eventually add better support for binary files? There are a number of hacks and bolt-on solutions, but it would be a lot easier to propose git for projects if it would just work as-is.
Re:How to Handle Big Git Repositories by skeletonjelly on Thursday March 12, 2015 @08:44PM (#9195040)
Wish Atlassian's Stash supported Git Annex natively