News for hackers. Stuff that matters.
Re:Keeping master green at scale by huac on Thursday April 18, 2019 @02:25PM (#19693487)
facebook, google, airbnb, quora, many more all use monorepo

obviously there are many others who do not use monorepo (amazon comes to mind) but it's reasonable to claim that they are actually widely used and fundamental when used

Re:Keeping master green at scale by jhenkens on Thursday April 18, 2019 @04:10PM (#19694351)
Microsoft uses it for Windows as well, which was so large they wrote their own git filesystem to power it.
Re:Keeping master green at scale by vruiz on Thursday April 18, 2019 @04:12PM (#19694366)
Does anybody know how these companies development environments look like? I know about Piper at Google but how do the rest manage? Does every single engineer have the entire monorepo in their machines?
Re:Keeping master green at scale by Shish2k on Friday April 19, 2019 @09:10AM (#19699274)
At facebook, a virtual filesystem (https://github.com/facebookexperimental/eden) + change monitor (https://facebook.github.io/watchman/) = source control operations run in O(files I have modified) instead of O(size of repository) time
Re:Keeping master green at scale by vruiz on Friday April 19, 2019 @10:10AM (#19699741)
Very interesting, thanks!
Re:Keeping master green at scale by YawningAngel on Thursday April 18, 2019 @04:29PM (#19694499)
Most places I know of use Git Virtual File System or equivalents.
Re:Keeping master green at scale by vruiz on Thursday April 18, 2019 @04:32PM (#19694530)
It is my understanding that VFSForGit only works on Windows.
Re:Keeping master green at scale by filoleg on Thursday April 18, 2019 @06:35PM (#19695394)
The github repo has instructions for running it on Mac and says that the stable Mac version is under active development.
Re:Keeping master green at scale by venantius on Thursday April 18, 2019 @04:43PM (#19694609)
Airbnb uses a monorepo for JVM-based project but most of Airbnb's code at least as of mid-2017 was not run on the JVM and was hosted multi-repo.
Re:Keeping master green at scale by fjp on Thursday April 18, 2019 @04:57PM (#19694700)
What are AirBnb's unique scaling issues other than just being a web app with tons of usage?

Uber has navigation, route optimization, queuing, etc. Facebook has to propagate activity our to massive and complex social network graphs.

I'm not discounting the toughness of operating at Airbnb's scale, but from my limited understanding it seems like they are not solving a new problem.

Re:Keeping master green at scale by novok on Thursday April 18, 2019 @05:24PM (#19694924)
Map search, automatic dynamic pricing, predicting busy periods, predicting user & provider preferences, etc.
Re:Keeping master green at scale by huac on Thursday April 18, 2019 @05:25PM (#19694931)
i was a data scientist so i knew of monorail but never touched that side of things :)
Re:Keeping master green at scale by twic on Friday April 19, 2019 @06:23AM (#19698327)
Notably, Netflix doesn't (or least didn't):

https://medium.com/netflix-techblog/towards-true-continuous-...

Re:Keeping master green at scale by chairleader on Thursday April 18, 2019 @10:13PM (#19696526)
til! Most of my experience with large, single-repository projects are just plain monoliths. The design goal we strive for tends to be the microservice architecture, assuming that isolation of responsibility leads to more maintainability, better decision making, etc. I can see how, with a well disciplined team, the monorepo could have the best of both worlds.
Re:Keeping master green at scale by bluGill on Thursday April 18, 2019 @03:58PM (#19694257)
Many companies do use a monorepo. Many other companies do not. There are trade offs.
Re:Keeping master green at scale by msangi on Thursday April 18, 2019 @03:24PM (#19694014)
All the companies have in common a huge budget they can invest on their build systems to overcome the shortcomings of monorepos.

They do have some benefits, but they also come with an immense cost

Re:Keeping master green at scale by patejam on Thursday April 18, 2019 @03:38PM (#19694124)
But that's what the OP's quote is saying. "large" companies use them.
Re:Keeping master green at scale by huac on Thursday April 18, 2019 @03:58PM (#19694258)
all of those companies were once small too