News for hackers. Stuff that matters.
Re:Benefits of a Monorepo by yegle on Wednesday May 01, 2019 @10:22AM (#19797222)
Wait what? As long as the build process is reproducible, why do you care if it's incremental or not? If you don't trust bazel, people have been using distcc+ccache since forever.
Re:Benefits of a Monorepo by Silhouette on Wednesday May 01, 2019 @10:43AM (#19797418)
Just as an anecdote, in all my time as a professional software developer, the number of projects I have worked on that have enjoyed reliable, reproducible, incremental builds is zero. The effects of global optimisations change. The output code winds up varying based on the order of incremental changes. Updated dependencies get overlooked because of race conditions or networking glitches or filesystem bugs or a hundred other unlikely but not impossible failures.

Incremental builds are great for quick day-to-day development, but in my experience they are invariably unsuitable for robust production builds. For me, those should use a git clone or equivalent into an empty directory and then a completely clean build of everything, always.

Re:Benefits of a Monorepo by lmm on Wednesday May 01, 2019 @11:30AM (#19797998)
> As long as the build process is reproducible, why do you care if it's incremental or not?

I wouldn't care if it was reliable. My experience is that it isn't.

> If you don't trust bazel, people have been using distcc+ccache since forever.

And it's been causing inconsistent builds all the while.

Re:Benefits of a Monorepo by robbrit on Wednesday May 01, 2019 @12:30PM (#19798765)
I've been using bazel (and the Google-internal version, blaze) for years now. The builds are extremely reliable and are used to deploy loads of projects across Google every day. I no longer work there, but my new company is also using bazel and we never run into issues with unreliable builds.

I think you're falling into the trap of "past solutions didn't work, therefore the problem is intractable", which is a special case of the "throwing the baby out with the bathwater" fallacy. Sometimes a new tool comes out that fixes the problems of past tools.

Re:Benefits of a Monorepo by lmm on Thursday May 02, 2019 @05:02AM (#19806007)
> I think you're falling into the trap of "past solutions didn't work, therefore the problem is intractable", which is a special case of the "throwing the baby out with the bathwater" fallacy. Sometimes a new tool comes out that fixes the problems of past tools.

Where's the breakthrough then? What's the magic that allows bazel to succeed where dozens of similar efforts have failed? Sometimes a new tool does fix the problems of past tools, but that's almost always due to some new insight.

Re:Benefits of a Monorepo by robbrit on Thursday May 02, 2019 @02:16PM (#19810842)
Not sure exactly, since I haven't used any of the dozens of similar efforts. It sounds like you're a lot more familiar with the area, so here's some resources:

* Bazel's FAQ: https://bazel.build/faq.html

* A description on how Blaze works: https://google-engtools.blogspot.com/2011/08/build-in-cloud-...

Unfortunately the design doc for Blaze is internal and AFAIK not available publicly. I imagine they took a look at a number of the similar efforts and made decisions based on what those approaches did wrong.

Re:Benefits of a Monorepo by mehrdada on Wednesday May 01, 2019 @07:59PM (#19802986)
While I can relate to your point, if you actually experience Blaze at Google (and Bazel too, but it has other ecosystem immaturity issues not related to reproducibility) you will quickly change your mind. I can totally see why prior tools you used may have put bad taste in your mouth.
Re:Benefits of a Monorepo by twic on Wednesday May 01, 2019 @10:38AM (#19797374)
The concern is that an incremental build is not reproducible. In theory, it is, but in practice, sometimes it is not.

Doing a clean build for the final artifact that is going to be released is pretty standard practice, IME.

Re:Benefits of a Monorepo by joshuamorton on Wednesday May 01, 2019 @11:01AM (#19797586)
Have you used bazel? The number of times I've even considered using `clean` (the drop some caches make everything mostly clean though still use the global cache command) in my 2+ years with it I can count one one hand, and most of those were unnecessary.