We Put Half a Million Files in One Git Repository, Here’s What We Learned

Re:We Put Half a Million Files in One Git Repository, Here’s... by kanu666 on Thursday June 16, 2022 @05:23AM (#31764005)

If you don't have a couple of hundreds engineers who would write a custom file system for git (Microsoft), or who would take an existing source control system and nearly fully rewrite it (Facebook), or who would write a custom source control system from scratch (Google, Yandex, etc) DON'T USE MONOREPO.

Otherwise you are risking to end up in a situation when hundreds of your engineers have to spend tens of minutes every time they need to simply push their code changes.

[ Parent | on HN ]

Re:We Put Half a Million Files in One Git Repository, Here’s... by jeffbee on Thursday June 16, 2022 @11:58AM (#31767539)

Google did not need to write their own SCM to reach the scale mentioned in the article. Off-the-shelf Perforce served that company well enough when it had tens of thousands of engineers and millions of files. They had 11 million files in a monorepo with one 256GB machine which most of you would consider a bare bones desktop computer at this point.

https://www.perforce.com/sites/default/files/still-all-one-s...

[ Parent | on HN ]

Re:We Put Half a Million Files in One Git Repository, Here’s... by danielheath on Thursday June 16, 2022 @05:33AM (#31764071)

I mean, if you have hundreds of engineers, that might be sound advice; if you have 20, you’ll probably be fine.

[ Parent | on HN ]

Re:We Put Half a Million Files in One Git Repository, Here’s... by kanu666 on Thursday June 16, 2022 @05:37AM (#31764092)

Of course, you shouldn't start a project from 10 repos. But the downside is while you live in a single repo all the tooling get tuned to work with a single repo. And then there is no way to go multi-repo when you need to.

So advice would be: start small but think big :)

[ Parent | on HN ]

Re:We Put Half a Million Files in One Git Repository, Here’s... by bregma on Thursday June 16, 2022 @06:55AM (#31764565)

There is no point in making any argument with someone who has the conviction of their religion behind them. Followers of the monorepo religion are no different.

[ Parent | on HN ]