News for hackers. Stuff that matters.
Re:Deno 1.45: Workspace and Monorepo Support by danpalmer on Friday July 12, 2024 @08:34AM (#40944951)
There's some truth to this. I'd say that perhaps Git is unsuitable above certain thresholds on numbers of files, numbers of commits, and size of data, but, that the size of data (and the fact that for certain file types this gets blown out on edits) is probably the one most people hit first – it sounds like you may have.

I've heard of git monorepos with >1k microservices, and it sounded like it wasn't a huge problem, but I think it likely had significantly less than 100GB. In fact I feel like you need to be committing large binary files to get towards that size.

Re:Deno 1.45: Workspace and Monorepo Support by azangru on Friday July 12, 2024 @08:50AM (#40945055)
> I'd say that perhaps Git is unsuitable above certain thresholds on numbers of files

Scott Chacon in a recent talk about git[0] said that Microsoft uses git to version control Windows. They have ~3.5 million files in the repo, which is about 300 gigabytes in size. There are some tweaks to improve git performance in those scenarios; but still, I'd say it's a pretty impressive threshold.

[0] - https://www.youtube.com/watch?v=aolI_Rz0ZqY

Re:Deno 1.45: Workspace and Monorepo Support by augusto-moura on Friday July 12, 2024 @08:53AM (#40945090)
There's a lot of "tweaks", they implemented a whole toolchain for virtualizing large repos: https://github.com/microsoft/scalar
Re:Deno 1.45: Workspace and Monorepo Support by re-thc on Friday July 12, 2024 @10:00AM (#40945642)
Most of those "tweaks" are no longer required. A lot of it has been merged back to git itself.