News for hackers. Stuff that matters.
Re:Why Google stores billions of lines of code in a single r... by kozhevnikov on Sunday December 10, 2017 @12:03AM (#15890027)
> monorepo this size would simply not scale on git

https://blogs.msdn.microsoft.com/bharry/2017/05/24/the-large...

Re:Why Google stores billions of lines of code in a single r... by codeka on Sunday December 10, 2017 @12:23AM (#15890088)
That's still not even close to Google's repository:

"The Google codebase includes approximately one billion files and has a history of approximately 35 million commits spanning Google's entire 18-year existence. The repository contains 86TBa of data, including approximately two billion lines of code in nine million unique source files."

Source: https://cacm.acm.org/magazines/2016/7/204032-why-google-stor...

Re:Why Google stores billions of lines of code in a single r... by nh2 on Sunday December 10, 2017 @12:56PM (#15892536)
Thanks for this quote.

It prompted me to do a quick afternoon experiment with how git would handle a billion lines of code:

https://news.ycombinator.com/item?id=15892518

Re:Why Google stores billions of lines of code in a single r... by joshuamorton on Sunday December 10, 2017 @07:35PM (#15894378)
As another user mentioned, many git actions scale linearly in the number of changes, not in the size of the repository. Try recreating the scaled repo, but say, in commits of 1000 lines each (ie. 200K commits), and see how long things take.
Re:Why Google stores billions of lines of code in a single r... by dmoy on Sunday December 10, 2017 @03:34PM (#15893352)
Did your experiment also do 40,000 changes per day (35 million commits, of varying sizes throughout the repo), and then see how that affects git performance? My (admittedly crappy) understanding of git is that it also scales on the commits, not just the raw file number/size count.
Re:Why Google stores billions of lines of code in a single r... by manojlds on Sunday December 10, 2017 @12:43AM (#15890153)
This is just the Windows codebase and is relatively small compared to almost the entirety of Google.