We Put Half a Million Files in One Git Repository, Here’s What We Learned

Re:We Put Half a Million Files in One Git Repository, Here’s... by ElemenoPicuares on Thursday June 16, 2022 @02:21AM (#31762971)

Canva gives users without design tools expertise the ability to make fairly polished looking graphics with a super easy and intuitive interface. (As a designer, I can assure you that polished looking is not the same thing as designed.) It’s a very popular service, so they’re dealing with huge scale. Intuitive interfaces often come with complex mechanisms and lots of assets, and they have clients on every major mobile and desktop platform, and the web. They also do a ton of heavy graphics processing that is likely done in lower-level languages than the interface.

The likelihood of a 2000 employee software company simply not considering that they could streamline their build process is pretty slim.

[ Parent | on HN ]

Re:We Put Half a Million Files in One Git Repository, Here’s... by necovek on Thursday June 16, 2022 @06:03AM (#31764237)

They have obviously invested a lot over time into streamlining their build process: so much so that they're putting an article about it.

All of the problems they are having are basically due to their use of a monorepo: they do explain that they made the decision early, but I wonder what are the advantages over multiple repos they are seeing that it was worth it all this trouble?

[ Parent | on HN ]

Re:We Put Half a Million Files in One Git Repository, Here’s... by ralphb on Thursday June 16, 2022 @11:17AM (#31767061)

We can talk about the advantages of monorepos, but your questions is phrased in a way that makes me think that you don't see any "trouble" in multiple repositories.

I would encourage you to do some research and keep an open mind.

[ Parent | on HN ]

Re:We Put Half a Million Files in One Git Repository, Here’s... by necovek on Thursday June 16, 2022 @02:34PM (#31769397)

I see "trouble" in all approaches: their solutions to manage their git monorepo approach it by switching to multi-repo emulation.

[ Parent | on HN ]

Re:We Put Half a Million Files in One Git Repository, Here’s... by etskinner on Thursday June 16, 2022 @01:39PM (#31768804)

They seem to have purposely left that out of the scope of this article. There are myriad articles about the benefits and downsides of monorepos vs multiple repos.

[ Parent | on HN ]

Re:We Put Half a Million Files in One Git Repository, Here’s... by necovek on Thursday June 16, 2022 @02:37PM (#31769420)

In another sibling comment I mentioned how I looked through their engineering blog and didn't see any post where they have talked about any of the benefits they are enjoying due to their use of monorepo.

The question is specifically about their usecase, since not everybody would hit the same bottlenecks as they did with git monorepos.

Iow, have they stopped and thought whether it's still worth it (eg how often do their engineers make use of the monorepo benefits like cross-project refactorings)?

[ Parent | on HN ]

Re:We Put Half a Million Files in One Git Repository, Here’s... by _the_inflator on Thursday June 16, 2022 @04:46AM (#31763783)

Don't rely on this anecdotal heuristic. Have a look at some enterprises. My experience: "How to solve scaling issues?" - "Automation? No, another team." ;)

[ Parent | on HN ]

Re:We Put Half a Million Files in One Git Repository, Here’s... by ElemenoPicuares on Thursday June 16, 2022 @01:07PM (#31768453)

This is not a 15k employee enterprise riveting features onto a codebase from the 90s— it’s a <10yo company that makes one product. Big difference in approach.

[ Parent | on HN ]