News for hackers. Stuff that matters.
Re:Spacex Launch Webcast: Formosat-5 Mission by inetknght on Thursday August 24, 2017 @03:38PM (#15093314)
I'd blame your source code more than Jenkins. Our jenkins instance runs our CI in a couple of minutes.
Re:Spacex Launch Webcast: Formosat-5 Mission by InclinedPlane on Thursday August 24, 2017 @03:45PM (#15093376)
Not everyone is working on projects that are little more than CRUD webapps. I've worked on code that took hours to compile even on beefy machines.
Re:Spacex Launch Webcast: Formosat-5 Mission by btilly on Thursday August 24, 2017 @05:47PM (#15094330)
I've worked on code that took that long to compile, and the cause of the problem was usually bad recursive makefiles doing work over and over again.

At the other extreme I've also worked at Google and have seen insanely complex C++ code bases compile in 30 seconds flat.

Multiple hour build times usually show that nobody smart enough had the interest and authority to solve the problem properly. It doesn't generally mean that your project is awesome. It certainly isn't something that I would brag about.

Re:Spacex Launch Webcast: Formosat-5 Mission by InclinedPlane on Friday August 25, 2017 @02:24AM (#15096544)
OK, that's great for google, but "complex" doesn't necessarily mean much. Do you think the linux kernel devs are slouches? The gcc devs? Both of those projects take hours to compile on reasonable hardware, and that's not for lack of trying.

Also, sometimes it's not about code, it's about digital assets, which is going to be IO bound. I've worked on projects that took a full working day to do a clean compile and others where it was necessary to do binary integrations instead of code because the overall build time would otherwise be measured in days or weeks.

Re:Spacex Launch Webcast: Formosat-5 Mission by inetknght on Thursday August 24, 2017 @04:03PM (#15093562)
The software analyzes DNA, it's definitely not a webapp
Re:Spacex Launch Webcast: Formosat-5 Mission by hinkley on Thursday August 24, 2017 @03:56PM (#15093488)
I got a 300k line Java app down to seven and a half minutes including unit and functional tests. What are you working with?
Re:Spacex Launch Webcast: Formosat-5 Mission by tcoff91 on Thursday August 24, 2017 @04:01PM (#15093538)
Probably a giant C++ codebase. Our CI runs can take well over an hour. C++ compiles so damn slowly compared to Java.
Re:Spacex Launch Webcast: Formosat-5 Mission by inetknght on Thursday August 24, 2017 @04:05PM (#15093582)
You should probably hire better C++ developers if it takes that long.
Re:Spacex Launch Webcast: Formosat-5 Mission by unvs on Thursday August 24, 2017 @05:50PM (#15094352)
Maybe you shouldn't prejudge the quality of developers on a project you know nothing about
Re:Spacex Launch Webcast: Formosat-5 Mission by corndoge on Thursday August 24, 2017 @04:56PM (#15093984)
you should probably become more experienced in c/c++ development before sharing your opinion
Re:Spacex Launch Webcast: Formosat-5 Mission by btilly on Thursday August 24, 2017 @05:50PM (#15094355)
You should see how quick C++ compilation times can be a competent organization like Google before dismissing that opinion.
Re:Spacex Launch Webcast: Formosat-5 Mission by InclinedPlane on Friday August 25, 2017 @02:25AM (#15096547)
Are you talking about clean builds or incremental builds?
Re:Spacex Launch Webcast: Formosat-5 Mission by btilly on Friday August 25, 2017 @04:12AM (#15096956)
They usually do incremental builds. And a lot of work goes into reproducible builds so that incremental builds can be trusted. But even clean builds are typically minutes of wall-clock time. Not hours.

Of course part of the trick is that work has been distributed across a cluster, so a lot longer was spent compiling than that...

Re:Spacex Launch Webcast: Formosat-5 Mission by wutwutwutwut on Thursday August 24, 2017 @04:37PM (#15093838)
How long should a giant C++ code base take to compile?
Re:Spacex Launch Webcast: Formosat-5 Mission by inetknght on Thursday August 24, 2017 @05:10PM (#15094096)
How giant is giant?

I've seen tens of thousands of lines of code compile in 30 minutes.

I've seen a hundred thousand lines of code compile in 2 minutes.

It really depends on how the project is laid out. If you're using lots of header-only libraries and try to compile monolithically (like soooooo many C++ applications do these days), you're going to have a bad (compile) time.

Re:Spacex Launch Webcast: Formosat-5 Mission by baq on Friday August 25, 2017 @04:43AM (#15097035)
tens of thousands? that's small. we're talking MLOCs here.
Re:Spacex Launch Webcast: Formosat-5 Mission by snovv_crash on Thursday August 24, 2017 @05:05PM (#15094055)
With a good CMake configuration and Ninja and ccache, a minute or two max.

Your CMake makes incremental builds safe, and the ccache saves you when switching between branches.

Re:Spacex Launch Webcast: Formosat-5 Mission by inetknght on Thursday August 24, 2017 @05:14PM (#15094124)
CMake helps a good bit, ccache goes further, and ninja helps a bit too. But none of them can help templated header-only libraries with complex interdependencies. It gets particularly bad when the developer #includes a convenience header to bring in _everything_ in the library instead of just what they need.
Re:Spacex Launch Webcast: Formosat-5 Mission by snovv_crash on Friday August 25, 2017 @01:55AM (#15096417)
Agreed. Good use of PImpl when you have large external header-only libraries is also generally recommended to keep the dependency graph nicer.

Also from what I've seen, large header-only codebases tend to be external and thus generally don't change that much, so if you can limit your own internal dependency tree ccache can still save you.