News for hackers. Stuff that matters.
Re:Advent of Sysadmin 2025 by swyx on Monday December 01, 2025 @12:11AM (#46103699)
bugs happen to all of us. whats your better solution - gitlab?
Re:Advent of Sysadmin 2025 by sharts on Monday December 01, 2025 @12:24AM (#46103775)
honestly jenkins really isnt that bad
Re:Advent of Sysadmin 2025 by bionsystem on Monday December 01, 2025 @03:13AM (#46104792)
Yeah I was thinking of using it for us actually. Connects to everything, lots of plugins, etc. I wonder what the hate is from, they are all pretty bad aren't they ?

Will test forgejo's CI first as we'll use the repo anyway, but if it ain't for me, it's going to be jenkins I assume.

Re:Advent of Sysadmin 2025 by n4bz0r on Monday December 01, 2025 @04:42AM (#46105406)
Cons:

  - DSL is harder to get into.
  - Hard to reproduce a setup unless builds are in DSL and Jenkins itself is in a fixed version container with everything stored in easily transferable bind volumes; config export/import isn't straightforward.
  - Builds tend to break in a really weird way when something (even external things like Gitea) updates.
  - I've had my setup broken once after updating Jenkins and not being able to update the plugins to match the newer Jenkins version.
  - Reliance on system packages instead of containerized build environment out of the box.
  - Heavier on resources than some of the alternatives.
Pros:

  - GUI is getting prettier lately for some reason.
  - Great extendability via plugins.
  - A known tool for many.
  - Can mostly be configured via GUI, including build jobs, which helps to get around things at first (but leads into the reproducibility trap later on).
Wouldn't say there is a lot of hate, but there are some pain points compared to managed Gitlab. Using managed Gitlab/Github is simply the easiest option.

Setting up your own Gitlab instance + Runners with rootless containers is not without quirks, too.

Re:Advent of Sysadmin 2025 by bionsystem on Monday December 01, 2025 @06:01AM (#46105973)
I have a previous experience with it. I agree with most points. Jobs can be downloaded as xml config and thus kept/versioned. But the rest is valid. I just don't want to manage gitlab, we already have it at corp level, just can't use it right now in preprod/prod and I need something which will be either throwaway or kept just for very specific tasks that shouldn't move much in the long run.
Re:Advent of Sysadmin 2025 by n4bz0r on Monday December 01, 2025 @06:54AM (#46106305)
For a throwaway, I don't think Jenkins will be much of a problem. Or any other tool for that matter. My only suggestion would be to still put some extra effort into building your own Jenkins container on top of the official one [0]. Add all the packages and plugins you might need to your image, so you can easily move and modify the installation, as well as simply see what all the dependencies are. Did a throwaway, non-containerized Jenkins installation once which ended up not being a throwaway. Couldn't move it into containers (or anywhere for that matter) without really digging in.

Haven't spent a lot of time with it myself, but if Jenkins isn't of much appeal, Drone [1] seems to be another popular (and lightweight) alternative.

[0] https://hub.docker.com/_/jenkins/

[1] https://www.drone.io

Re:Advent of Sysadmin 2025 by maratc on Monday December 01, 2025 @11:34AM (#46109423)
CASC plugin + seed jobs keep all your jobs/configurations in files and update them as needed, and k8s + Helm charts can keep the rest of config (plugins, script approvals, nodes, ...) in a manageable file-based state as well.

We have our main node in a state that we can move it anywhere in a couple of minutes with almost no downtime.

I'll add another point to "Pros": Jenkins is FOSS and it costs $0 per developer per month.

Re:Advent of Sysadmin 2025 by friendzis on Monday December 01, 2025 @09:42AM (#46107997)
Hudson/Jenkins is just not architected for large, multi-project deployments, isolated environments and specialized nodes. It can work if you do not need these features, but otherwise it's fight against the environment.

You need a beefy master and it is your single point of failure. Untimely triggers of heavy jobs overwhelm controller? All projects are down. Jobs need to be carefully crafted to be resumable at all.

Heavy reliance on master means that even sending out webhooks on stage status changes is extremely error prone.

When your jobs require certain tools to be available you are expected to package those as part of agent deployment as Jenkins relies on host tools. In reality you end up rolling your own tool management system that every job has to call in some canonical manner.

There is no built in way to isolate environments. You can harden the system a bit with various ACLs, but in the end if you either have to trust projects or build up and maintain infrastructures for different projects isolated at host level.

In cases when time-wise significant processing happens externally, you have to block an executor.

Re:Advent of Sysadmin 2025 by esseph on Monday December 01, 2025 @01:35AM (#46104221)
GitLab pipelines are really good.
Re:Advent of Sysadmin 2025 by Balinares on Monday December 01, 2025 @02:30AM (#46104537)
Not in love with its insistence on recreating the container from scratch every step of the pipeline, among a bundle of other irksome quirks. There are certainly worse choices, though.
Re:Advent of Sysadmin 2025 by friendzis on Monday December 01, 2025 @08:02AM (#46106909)
Opposite of Jenkins where you have shared workspaces and have to manually ensure workspace is clean or suffer from reproducibility issues with tainted workspaces.
Re:Advent of Sysadmin 2025 by maratc on Monday December 01, 2025 @02:11PM (#46111659)
It's up to you whether you have a shared workspace or not. My machines/pods are destroyed and recreated after each job, so I never had this issue.
Re:Advent of Sysadmin 2025 by esseph on Monday December 01, 2025 @07:08PM (#46115452)
You don't actually have to.

If you use the built in container registry and build artifacts, you can pass between steps.

Re:Advent of Sysadmin 2025 by Balinares on Wednesday December 03, 2025 @03:05PM (#46139335)
I'm aware, but thank you. Unfortunately, given sufficiently large artifacts, the overhead of packaging, uploading, downloading and unpacking them at every step becomes prohibitive.
Re:Advent of Sysadmin 2025 by shoo on Monday December 01, 2025 @02:44AM (#46104610)
Roll 2d6, sum result. Your CI migration target is:

  2. migrate secret manager. Roll again
  3. cloud build
  4. gocd
  5. jenkins
  6. gitlab
  7. github actions
  8. bamboo
  9. codepipeline
  10. buildbot
  11. team foundation server
  12. migrate version control. Roll again
Re:Advent of Sysadmin 2025 by swyx on Monday December 01, 2025 @03:28AM (#46104888)
somehow i am really liking the kind of people that comment in the comment sections of sysadmin posts. i wonder what personality type this is
Re:Advent of Sysadmin 2025 by n4bz0r on Monday December 01, 2025 @04:25AM (#46105274)
Sysadmin.
Re:Advent of Sysadmin 2025 by speakspokespok on Monday December 01, 2025 @05:34AM (#46105786)
SysEng
Re:Advent of Sysadmin 2025 by mroche on Monday December 01, 2025 @01:58PM (#46111466)
Bump up to 2d10 and add:

    - Travis
    - CircleCI
    - Drone/Woodpecker
    - Tekton Pipelines
    - TeamCity
    - Zuul
    - Buildkite
    - Agola
Re:Advent of Sysadmin 2025 by flyer23 on Monday December 01, 2025 @06:56PM (#46115334)
IBM ClearCase anyone? Noone? I AM old