Re:Improving large monorepo performance on GitHub
by cmurphycode on Tuesday March 16, 2021 @10:05PM
(#26485672)
I was really taken aback by this given my previous experience with the Linux kernel git repo size. So, I just checked out Graal.
Receiving objects: 100% (981372/981372), 187.08 MiB | 6.39 MiB/s, done.
% du -sh graal 328M graal
% du -sh .git 221M .git
And that includes many binary files that were added and removed over time, but not filter-branched out of existence, including jars, pngs, pdfs :)
(https://stackoverflow.com/questions/10622179/how-to-find-ide...)
Re:Improving large monorepo performance on GitHub
by chrisseaton on Tuesday March 16, 2021 @10:10PM
(#26485694)
Huh... maybe I have a degenerate copy for having it so long and I should try running the compression commands myself.
Re:Improving large monorepo performance on GitHub
by lathiat on Tuesday March 16, 2021 @11:28PM
(#26486177)
See also “git prune” to remove references to branches and objects no longer on the remote server. Check the docs though I think in some cases I might delete local branches or objects so make a backup first.
Re:Improving large monorepo performance on GitHub
by andrewstuart2 on Tuesday March 16, 2021 @08:29PM
(#26485070)
I'm totally not surprised that large repos exist, without having fallen prey to any antipatterns. Just saying that I know "have you committed any binaries, dependencies, generated code, etc" are the first questions I tend to ask when somebody tells me their repo is massive. In part selection bias, though, because usually the people working on super old projects know exactly why.
https://github.com/oracle/graal
It's not even a mono-repo - this is just part of the project.
Maybe someone's got some tools that let them dig around in the history and find large things or explain why it's so large? I don't think they've been checking ISOs in.