News for hackers. Stuff that matters.
Re:Why Google Stores Billions of Lines of Code in a Single R... by spion on Monday February 13, 2023 @03:19PM (#34779769)
> How many internal libraries does your "separate services" contain? You service A depends on library alpha@1, your service B depends on library alpha@2. All happy now. Introduce another layer, your service A depends on library alpha@1, beta@1, and alpha@1 depends on gamma@1, beta@1 depends on gamma@2, what to do now? It does not even matter how many services you have now.

To start using beta@1 you need to upgrade alpha@1 to alpha@2 that depends on gamma@2. What's the problem with that?

The same situation can arise with 3rd party dependencies, except there its much worse: you have zero control over those. Here you do have the control.

Now lets look at what this situation looks like in a monorepo: you can't even introduce gamma@2 and make beta@1 at all without

1. upgrading alpha@1 to alpha@2

2. upgrading all services that depend on alpha@2

3. upgrading all libraries that depend on gamma@2

4. upgrading all services that depend on gamma@2, if any

So you might even estimate that the cost of developing beta@2 is not worth it at all. Instead of quasi-dependency-hell ("quasi" because your company still controlls all those libraries and has power to fix the issue unlike real dependency hell) you have a real stagnation hell due to thousand papercuts

Re:Why Google Stores Billions of Lines of Code in a Single R... by spion on Monday February 13, 2023 @05:38PM (#34781912)
Note: steps 1-4 will likely be done in somewhat reverse order (3,4 first, then 1,2, the building `beta`)
Re:Why Google Stores Billions of Lines of Code in a Single R... by rfoo on Tuesday February 14, 2023 @02:09AM (#34786389)
> To start using beta@1 you need to upgrade alpha@1 to alpha@2 that depends on gamma@2. What's the problem with that?

The problem is the team maintaining alpha does not want to upgrade to gamma@2 because it's an extra burden for them, and they don't have an immediate need.

The debate is not about teams owning separate services, it's about teams owning libraries.

Re:Why Google Stores Billions of Lines of Code in a Single R... by spion on Tuesday February 14, 2023 @03:34AM (#34786900)
I'm assuming a customer-driven culture where you work for your customers needs. In the case of libraries, teams using the libraries are customers. If you're the maintainer of alpha and your customer needs beta, your customer needs you to upgrade to gamma.
Re:Why Google Stores Billions of Lines of Code in a Single R... by rfoo on Tuesday February 14, 2023 @03:44AM (#34786974)
But then another customer still wants gamma@1, they are allowed to do that! But they also want your new features. So now you have to maintain two branches, which I hope we can agree: it is an extra burden.

This is unavoidable if we are talking about FOSS, people should be able to do whatever they want, and they do. A company has an advantage here: you can install company-wide rules and culture to make sure people don't do this. Which, in this case, happens to be: let's keep a single version of everything unless you have really good reasons.

Re:Why Google Stores Billions of Lines of Code in a Single R... by spion on Tuesday February 14, 2023 @04:16AM (#34787159)
> But then another customer still wants gamma@1, they are allowed to do that! But they also want your new features.

In this case, you still have the option of working with them to help them migrate to gamma@2, if the cost of maintaining gamma@1 is indeed too high and would negatively impact you in serving other customers. This was the original premise, wasn't it - upgrading all your dependants when you upgrade your library? That's still an option. The point is - you have more choices. And you can also help customers one by one - you don't have to do it all at once

I will agree though, restricting choices helps when the company is finding difficulty in aligning incentives through communication. But you do give up a lot for it - including ability to move fast and avoid stagnation.

Re:Why Google Stores Billions of Lines of Code in a Single R... by rfoo on Tuesday February 14, 2023 @04:57AM (#34787409)
Ah, ok. I see where you are coming from :)

From what I saw I'd say it's exactly opposite: allowing multiple versions actually means "make teams able to choose for stagnation". And because we are lazy, we certainly do! There is a non-trivial amount of people who believes "if it ain't broken don't fix it". I can work with them to migrate them over, but they might not want to do so! In this case, a hard "bump versions or die" rule is a must.

Maybe if you work in a small group of great engineers you don't need to set such rules and you can move even faster, but I unfortunately haven't found such a workplace :(

> you don't have to do it all at once

Yes. Nobody should do it all at once. Making "bump versions or die" compatible with incremental adoption is slightly harder (see sibling threads for how it's done). Still worth it I'd argue.