News for hackers. Stuff that matters.
Re:FreeBSD 12.2-BETA1 by Mister_Snuggles on Monday September 14, 2020 @11:47AM (#24471530)
I really like FreeBSD, and I run it on my home server, but the whole update process really needs a lot of work. The process described in this announcement is accurate in my experience: Run freebsd-update twice, reboot, run freebsd-update again, reinstall or rebuild applications, reboot again, run freebsd-update yet again.

The upgrade process works well, but it's much more manual than it is in the Linux world.

When PkgBase[0] becomes a thing, I hope that the process will be closer to the Linux world.

The other thing that hurts the upgrade process is the lack of packaged software. My big pain point is currently PostgreSQL 12+PostGIS 3.0. This combination in FreeBSD isn't a thing, the packaged/ported PostGIS 3.0[1] is for PostgreSQL 11. My solution has been to build PostgreSQL 12 from ports (because the packaged version doesn't include XML support, which I also want) then build PostGIS 3.0 from source, after installing all its dependencies from packages. I have to rebuild PostGIS after most FreeBSD upgrades since it links against now-changed libraries. If I were doing this in the OpenSuse world I would just use the Applications:Geo repository[2] and be able to install the right combination of software very easily.

Because of these issues, I'm slowly moving towards using FreeBSD to host VMs running whatever OS/distribution is most appropriate for the job. Moving PostgreSQL off of FreeBSD will greatly simplify my upgrade process.

[0] https://wiki.freebsd.org/PkgBase

[1] https://www.freshports.org/databases/postgis30/

[2] https://build.opensuse.org/project/show/Application:Geo

Re:FreeBSD 12.2-BETA1 by bluGill on Monday September 14, 2020 @01:48PM (#24472983)
While I mostly agree, you also hit the power of the freebsd system: you can do something different. In linux if you want PostgreSQL 12+PostGIS 3.0 with xml support and the packages deliver PostgreSQL 12+PostGIS 3.0 without xml you are stuck without xml support as the package systems don't make it easy for lay people to select options. With FreeBSD you get that power if you want it.

It should be easier though.

Re:FreeBSD 12.2-BETA1 by MrMorden on Wednesday September 16, 2020 @01:52AM (#24489924)
I don't update Linux, FreeBSD, or any other OS in place except on my FreeBSD-CURRENT desktop. The only way to operate in production is to create a new VM from your template, apply the runbook/state/whatever, route everything to the new VM, and drain the old VM.

My personal systems aren't where they should be for CM, but I still can't think of a good reason to update in place rather than rebuild and copy over configuration/data.

Flavors should make it easier to operate with packages instead of ports, but I don't have any idea what's going on there. If I were supporting a large number of systems, I'd want FreeBSD over Linux any day of the week and twice on Sundays because the ports system doesn't make you choose between a stable OS branch and current software.

Re:FreeBSD 12.2-BETA1 by asveikau on Monday September 14, 2020 @12:09PM (#24471821)
I actually think there is nothing wrong with the upgrade process. What about pkg-style makes it better? On those other systems you still need a reboot for kernel changes to take effect.
Re:FreeBSD 12.2-BETA1 by Mister_Snuggles on Monday September 14, 2020 @12:19PM (#24471935)
It's more the number of reboots and invocations of freebsd-update. Since these are all manual steps, you need to keep track of where you are and invoke the next step manually.

The current process for upgrading FreeBSD is roughly, assuming that you're just using packages and not ports is:

* freebsd-update upgrade

* freebsd-update install

* reboot

* freebsd-update install

* pkg upgrade

* reboot

* freebsd-update install

* (optional) reboot

In comparison, the process for upgrading OpenSuse Tumbleweed, assuming that you're just using packaged software, is:

* zypper dup

* reboot

If the base system were managed by pkg, the FreeBSD version of the process should probably look a lot like the OpenSuse Tumbleweed version. Condensing upgrades down to a two-step process seems like it will be a significant quality-of-life improvement to me.

Re:FreeBSD 12.2-BETA1 by toast0 on Monday September 14, 2020 @12:48PM (#24472270)
I think there's value to having base separate from pkg, too. The way we ran FreeBSD at the two companies I worked where it was used heavily was to manage base and other things separately.

For base updates, we'd usually shut down services, install kernel and userland, and reboot --- I know this isn't the proper order, but most of the time the new userland is compatible enough to reboot (and you can usually power cycle if that doesn't work out). For updates where rebooting would be hard this way, we'd do it the right way, but then you need to add an extra reboot after installing userland, or restart all the services from base. If needed, we'd install the compat packages after the reboot. We would not update ports/pkg/etc at the same time; old binaries are expected to continue to work on a new system (and generally do). In house binaries are either compiled on the system they run, or centrally on a machine (or chroot/jail) running the oldest release on the fleet.

Generally,

When you need to upgrade software not from base, because of security updates or new features or ennui, you do that isolated from base changes. The only complication here is if you haven't updated base recently enough, pkg may provide binaries you can't run, and ports may provide software you can't compile (this one takes longer).

We would generally only update base for exceptional releases, or when it became hard to update non-base software on older releases. However, new machine installs would get the most recent release we had tested.

Re:FreeBSD 12.2-BETA1 by asveikau on Monday September 14, 2020 @12:26PM (#24472017)
But if there are ABI breakages in base (say, a new syscall used in libc) you want to boot the new kernel with the old userland, then get the new userland later.

At least, I have heard this explanation in the context of OpenBSD, and assume it may also apply to FreeBSD.

Re:FreeBSD 12.2-BETA1 by Mister_Snuggles on Monday September 14, 2020 @12:38PM (#24472164)
I believe that's the same in FreeBSD as well. I also think it's a solved problem in the Linux world - OpenSuse Tumbleweed sometimes rebuilds every package because they've changed libc. Apart from watching 2000+ packages get updated, there's really no impact when this happens.

To solve this, the updater could create a new boot environment[0], install everything in that boot environment using as many passes as required, then reboot into that environment. OpenSuse already does a similar thing[1], though I don't know how well it works.

[0] https://www.freebsd.org/cgi/man.cgi?beadm

[1] https://news.opensuse.org/2018/05/15/transactional-updates-i...

Re:FreeBSD 12.2-BETA1 by asveikau on Monday September 14, 2020 @12:41PM (#24472198)
The situation on linux is actually different because the kernel and glibc are maintained separately and the syscall ABI is treated as a boundary between components.

Any time a new syscall is wrapped the userland maintainers need to account for what happens when run on an old kernel and typically have some fallback logic.

Re:FreeBSD 12.2-BETA1 by marmaduke on Monday September 14, 2020 @12:33PM (#24472090)
Sounds like a great yak-shaving opportunity, to write a script that automates it
Re:FreeBSD 12.2-BETA1 by nix23 on Monday September 14, 2020 @12:59PM (#24472413)
Which everyone does, if one has more then 2 machines ;)
Re:FreeBSD 12.2-BETA1 by 293984j29384 on Monday September 14, 2020 @12:37PM (#24472151)
I absolutely agree. I run FreeBSD on my NAS to take advantage of ZFS but every time I update it I have to Google the process or find my notes since it's incredibly non-intuitive.
Re:FreeBSD 12.2-BETA1 by Mister_Snuggles on Monday September 14, 2020 @12:47PM (#24472267)
I have a detailed set of instructions to follow when I'm upgrading my home server, plus notes from each time I've upgraded it.

At this point, I've only got two services (postgresql and mosquitto) which run on bare metal, everything else is in VMs. Once I move those off of FreeBSD the upgrade process will be greatly simplified (well, as simplified as FreeBSD gets anyway).

Re:FreeBSD 12.2-BETA1 by asveikau on Monday September 14, 2020 @12:49PM (#24472287)
freebsd-update prints out what you need to do next at each step though. If it wants you to reboot and run it again it says that.
Re:FreeBSD 12.2-BETA1 by nix23 on Monday September 14, 2020 @01:00PM (#24472428)
Or you just read the printout until it says fetch first ;)
Re:FreeBSD 12.2-BETA1 by nix23 on Monday September 14, 2020 @11:51AM (#24471589)
Why do you not use poudriere? And build automatically everything from ports then install the build-ed packages on you machine's?
Re:FreeBSD 12.2-BETA1 by Mister_Snuggles on Monday September 14, 2020 @11:56AM (#24471658)
This is something I've been meaning to look into, but it still doesn't change the postgis30/postgresql11-server dependency in the current ports tree.

I'm sure I could work around it, but then I start to ask myself whether I'd rather do FreeBSD software administration or create an OpenSuse VM, install the packaged software (which is already the right version and already has the right config options), and work on my GIS project.

Re:FreeBSD 12.2-BETA1 by nix23 on Monday September 14, 2020 @12:57PM (#24472391)
>but it still doesn't change the postgis30/postgresql11-server dependency in the current ports tree

If you tell make.conf that postgres12 is the default it will compile postgis for that version, same with php/ruby/mysql and so on.

Re:FreeBSD 12.2-BETA1 by asveikau on Monday September 14, 2020 @12:07PM (#24471787)
I feel poudriere takes too much time and disk space building literally everything. I would like it to pick up dependencies from pkg and only build stuff from source when I have options changed.

Incidentally I wrote a shell script that does this.

Re:FreeBSD 12.2-BETA1 by nix23 on Monday September 14, 2020 @12:55PM (#24472361)
>I feel poudriere takes too much time and disk space building literally everything.

No not really just your packages and the dependencies of those.

Re:FreeBSD 12.2-BETA1 by asveikau on Monday September 14, 2020 @01:03PM (#24472456)
Ok, slight exaggeration. The dependencies get quite huge though, especially when you are using something substantial.
Re:FreeBSD 12.2-BETA1 by nix23 on Monday September 14, 2020 @02:59PM (#24473776)
Yeah that's true, having 1400 pkg installed needs often ~300 pkg to rebuild...but hey then you know everything is in harmony ;)
Re:FreeBSD 12.2-BETA1 by asveikau on Monday September 14, 2020 @07:39PM (#24476397)
Building both gcc and llvm from scratch (which somehow usually ends up happening) is probably more harmony than I need in my life.
Re:FreeBSD 12.2-BETA1 by nix23 on Tuesday September 15, 2020 @06:40AM (#24479708)
Both are faster build then chrome or Firefox ;)
Re:FreeBSD 12.2-BETA1 by dddddaviddddd on Monday September 14, 2020 @01:57PM (#24473083)
I usually upgrade by recompiling the OS. Minor updates only take a few minutes to compile using filemon and the WITH_META_MODE=YES environment variable. The advantage is that it's easy to maintain out-of-tree patches to the source.