News for hackers. Stuff that matters.
Re:Bento: Jupyter Notebooks at Meta by master_crab on Wednesday September 18, 2024 @11:47PM (#41588305)
If git is blocking you, you are using it wrong. Lotta instances of people treating it as an artifact repository. Use it correctly with a branching strategy that works for your use case and it's bulletproof.

Plenty of other customers with the same magnitude problems as Meta are using Git perfectly fine.

Re:Bento: Jupyter Notebooks at Meta by quicklime on Thursday September 19, 2024 @12:57AM (#41588656)
Who are the others with the same magnitude as Google and Meta’s monorepos?
Re:Bento: Jupyter Notebooks at Meta by disgruntledphd2 on Thursday September 19, 2024 @02:19AM (#41589107)
Particularly in 2014, when the git thing happened.
Re:Bento: Jupyter Notebooks at Meta by master_crab on Thursday September 19, 2024 @08:35AM (#41591180)
No one. Because people should know better than to use monorepos. Most teams at Amazon (which works at the same scale) religiously avoided them.
Re:Bento: Jupyter Notebooks at Meta by ec109685 on Thursday September 19, 2024 @09:45AM (#41591768)
Microsoft has all of windows in a single repository.
Re:Bento: Jupyter Notebooks at Meta by KaiserPro on Thursday September 19, 2024 @05:52AM (#41590192)
> Plenty of other customers with the same magnitude problems as Meta are using Git perfectly fine.

I mean there aren't. there are perhaps three places that have the same scale problem.

A monorepo for a place with about 50k developers, that has been operating at that scale for 5 years.

The current checkout if not sparse would be >80gigs

The commit rate is > 20 a second.

no amount of branching strategy is going to help on that.

I love git, I used it professionally since 2010, but git is not a good fit for something _massive_

Re:Bento: Jupyter Notebooks at Meta by ec109685 on Thursday September 19, 2024 @09:48AM (#41591801)
Microsoft has made git work for massive repositories through a lot of blood sweat and tears: https://github.blog/open-source/git/the-story-of-scalar/