News for hackers. Stuff that matters.
Re:ZFS 2.3.0 released with ZFS raidz expansion by kwanbix on Tuesday January 14, 2025 @05:30AM (#42695736)
Honest question. As an end user that uses Windows and Linux and does not uses ZFS, what I am missing?
Re:ZFS 2.3.0 released with ZFS raidz expansion by poisonborz on Tuesday January 14, 2025 @05:48AM (#42695830)
Way better data security, resilience against file rotting. This goes for both HDDs or SSDs. Copy-on-write, snapshots, end to end integrity. Also easier to extend the storage for safety/drive failure (and SSDs corrupt in a more sneaky way) with pools.
Re:ZFS 2.3.0 released with ZFS raidz expansion by wil421 on Tuesday January 14, 2025 @05:53AM (#42695861)
How many of us are using single disks on our laptops? I have a NAS and use all of the above but that doesn’t help people with single drive systems. Or help me understand why I would want it on my laptop.
Re:ZFS 2.3.0 released with ZFS raidz expansion by ryao on Tuesday January 14, 2025 @06:03AM (#42695912)
My thinkpad from college uses ZFS as its rootfs. The benefits are:

  * If the hard drive / SSD corrupted blocks, the corruption would be identified.
  * Ditto blocks allow for self healing. Usually, this only applies to metadata, but if you set copies=2, you can get this on data too. It is a poor man’s RAID.
  * ARC made the desktop environment very responsive since unlike the LRU cache, ARC resists cold cache effects from transient IO workloads.
  * Transparent compression allowed me to store more on the laptop than otherwise possible.
  * Snapshots and rollback allowed me to do risky experiments and undo them as if nothing happened.
  * Backups were easy via send/receive of snapshots.
  * If the battery dies while you are doing things, you can boot without any damage to the filesystem.
That said, I use a MacBook these days when I need to go outside. While I miss ZFS on it, I have not felt motivated to try to get a ZFS rootfs on it since the last I checked, Apple hardcoded the assumption that the rootfs is one of its own filesystems into the XNU kernel and other parts of the system.
Re:ZFS 2.3.0 released with ZFS raidz expansion by CoolCold on Tuesday January 14, 2025 @07:02AM (#42696231)
NTFS had compression since mot even sure when.

For other stuff, let that nerdy CorpIT handle your system.

Re:ZFS 2.3.0 released with ZFS raidz expansion by ryao on Tuesday January 14, 2025 @07:23AM (#42696373)
Its compression is slow and has a low compression ratio. ZFS has both zstd and lz4.
Re:ZFS 2.3.0 released with ZFS raidz expansion by adgjlsfhk1 on Tuesday January 14, 2025 @10:25AM (#42698339)
yes but NTFS is bad enough that no one needs to be told how bad it is.
Re:ZFS 2.3.0 released with ZFS raidz expansion by rabf on Tuesday January 14, 2025 @09:38AM (#42697717)
Not ever having to deal with partitions and instead using data sets each of which can have their own properties such as compression, size quota, encryption etc is another benefit. Also using zfsbootmenu instead of grub enables booting from different datasets or snapshots as well as mounting and fixing data sets all from the bootloader!
Re:ZFS 2.3.0 released with ZFS raidz expansion by artificialLimbs on Wednesday January 15, 2025 @01:04AM (#42707834)
Alright that's a bit mind blowing. TIL. Thank you. =)
Re:ZFS 2.3.0 released with ZFS raidz expansion by ekianjo on Tuesday January 14, 2025 @05:58AM (#42695886)
It provides encryption by default without having to deal with LUKS. And no need to ever do fsck again.
Re:ZFS 2.3.0 released with ZFS raidz expansion by Twey on Tuesday January 14, 2025 @07:29AM (#42696441)
Except that swap on OpenZFS still deadlocks 7 years later (https://github.com/openzfs/zfs/issues/7734) so you're still going to need LUKS for your swap anyway.
Re:ZFS 2.3.0 released with ZFS raidz expansion by ryao on Tuesday January 14, 2025 @08:22AM (#42696832)
Another option is to go without swap. I avoid swap on my machines unless I want hibernation support.
Re:ZFS 2.3.0 released with ZFS raidz expansion by yjftsjthsd-h on Tuesday January 14, 2025 @09:13AM (#42697412)
If the single drive in your laptop corrupts data, you won't know. ZFS can't fix corruption without extra copies, but it's still useful to catch the problem and notify the user.

Also snapshots are great regardless.

Re:ZFS 2.3.0 released with ZFS raidz expansion by Polizeiposaune on Tuesday January 14, 2025 @11:41AM (#42699691)
In some circumstances it can.

Every ZFS block pointer has room for 3 disk addresses; by default, the extras are used only for redundant metadata, but they can also be used for user data.

When you turn on ditto blocks for data (zfs set copies=2 rpool/foo), zfs can fix corruption even on single-drive systems at the cost of using double or triple the space. Note that (like compression), this only affects blocks written after the setting is in place, but (if you can pause writes to the filesystem) you can use zfs send|zfs recv to rewrite all blocks to ensure all blocks are redundant.

Re:ZFS 2.3.0 released with ZFS raidz expansion by jeroenhd on Tuesday January 14, 2025 @06:05AM (#42695929)
The data security and rot resilience only goes for systems with ECC memory. Correct data with a faulty checksum will be treated the same as incorrect data with a correct checksum.

Windows has its own extended filesystem through Storage Spaces, with many ZFS features added as lesser used Storage Spaces options, especially when combined with ReFS.

Re:ZFS 2.3.0 released with ZFS raidz expansion by abrookewood on Tuesday January 14, 2025 @06:29AM (#42696042)
Please stop repeating this, it is incorrect. ECC helps with any system, but it isn't necessary for ZFS checksums to work.
Re:ZFS 2.3.0 released with ZFS raidz expansion by _factor on Tuesday January 14, 2025 @07:07AM (#42696272)
This has nothing to do with ZFS as a filesystem. It has integrity verification on duplicated raid configurations. If the system memory flips a bit, it will get written to disk like all filesystems. If a bit flips on a disk, however, it can be detected and repaired. Without ECC, your source of truth can corrupt, but this true of any system.
Re:ZFS 2.3.0 released with ZFS raidz expansion by BSDobelix on Tuesday January 14, 2025 @07:04AM (#42696250)
On zfs there is the ARC (adaptive read cache), on non-zfs systems this "read cache" is called buffer, both reside in memory, so ECC is equally important for both systems.

Rot means changing bits without accessing those bits, and that's ~not possible with zfs, additionally you can enable check-summing IN the ARC (disabled by default), and with that you can say that ECC and "enterprise" quality hardware is even more important for non-ZFS systems.

>Correct data with a faulty checksum will be treated the same as incorrect data with a correct checksum.

There is no such thing as "correct" data, only a block with a correct checksum, if the checksum is not correct, the block is not ok.

Re:ZFS 2.3.0 released with ZFS raidz expansion by mrb on Tuesday January 14, 2025 @08:18AM (#42696792)
"data security and rot resilience only goes for systems with ECC memory."

No. Bad HDDs/SSDs or bad SATA cables/ports cause a lot more data corruption than bad RAM. And ZFS will correct these cases even without ECC memory. It's a myth that the data healing properties of ZFS are useless without ECC memory.

Re:ZFS 2.3.0 released with ZFS raidz expansion by elseless on Tuesday January 14, 2025 @12:55PM (#42701014)
Precisely this. And don’t forget about bugs in virtualization layers/drivers — ZFS can very often save your data in those cases, too.
Re:ZFS 2.3.0 released with ZFS raidz expansion by ryao on Tuesday January 14, 2025 @01:53PM (#42701970)
I once managed to use ZFS to detect a bit flip on a machine that did not have ECC RAM. All python programs started crashing in libpython.so on my old desktop one day. I thought it was a bug in ZFS, so I started debugging. I compared the in-memory buffer from ARC with the on-disk buffer for libpython.so and found a bit flip. At the time, accessing a snapshot through .zfs would duplicate the buffer in ARC, which made it really easy to compare the in-memory buffer against the on-disk buffer. I was in shock as I did not expect to ever see one in person. Since then, I always insist on my computers having ECC.
Re:ZFS 2.3.0 released with ZFS raidz expansion by e12e on Tuesday January 14, 2025 @06:07AM (#42695939)
Cross platform native encryption with sane fs for removable media.
Re:ZFS 2.3.0 released with ZFS raidz expansion by lazide on Tuesday January 14, 2025 @06:18AM (#42695995)
Who would that help?

MacOS also defaults to a non-portable FS for likely similar reasons, if one was being cynical.

Re:ZFS 2.3.0 released with ZFS raidz expansion by e12e on Wednesday January 15, 2025 @11:14AM (#42712761)
It would help users using USB sticks, external drives?

Couple it with encrypted zfs send/receive for cross platform secure backups.

Re:ZFS 2.3.0 released with ZFS raidz expansion by lazide on Wednesday January 15, 2025 @03:32PM (#42716517)
I meant, why would they prioritize cross platform when it doesn’t help them?
Re:ZFS 2.3.0 released with ZFS raidz expansion by madeofpalk on Tuesday January 14, 2025 @05:39AM (#42695783)
I'm missing file clones/copy-on-write.
Re:ZFS 2.3.0 released with ZFS raidz expansion by chillfox on Tuesday January 14, 2025 @09:06AM (#42697340)
Much faster launch of applications/files you use regularly. Ability to always rollback updates in seconds if they cause issues thanks to snapshots. Fast backups with snapshots + zfs send/receive to a remote machine. Compressed disks, this both let's you store more on a drive and makes accessing files faster. Easy encryption. ability to mirror 2 large usb disks so you never have your data corrupted or lose it from drive failures. Can move your data or entire os install to a new computer easily by using a live disk and just doing a send/receive to the new pc.

(I have never used dedup, but it's there if you want I guess)

Re:ZFS 2.3.0 released with ZFS raidz expansion by wkat4242 on Tuesday January 14, 2025 @10:01AM (#42698016)
Snapshots (Note: NTFS does have this in the way of Volume Shadow Copy but it's not as easily accessible as a feature to the end user as it is in ZFS). Copy on Write for reliability under crashes. Block checksumming for data protection (bitrot)
Re:ZFS 2.3.0 released with ZFS raidz expansion by johannes1234321 on Tuesday January 14, 2025 @10:27AM (#42698372)
For a while I ran Open Solaris with ZFS as root filesystem.

The key feature for me, which I miss, is the snapshotting integrated into the package manager.

ZFS allows snapshots more or less for free (due to copy on weite) including cron based snapshotting every 15 minutes. So if I did a mistake anywhere there was a way to recover.

And that integrated with the update manager and boot manager means that on an update a snapshot is created and during boot one can switch between states. Never had a broken update, but gave a good feeling.

On my home server I like the raid features and on Solaris it was nicely integrated with NFS etc so that one can easily create volumes and export them and set restrictions (max size etc.) on it.

Re:ZFS 2.3.0 released with ZFS raidz expansion by attentive on Tuesday January 14, 2025 @06:14PM (#42705246)
> is the snapshotting integrated into the package manager.

some linux distros have that by default with btrfs. And usually it's a package install away if you're already on btrfs.

Re:ZFS 2.3.0 released with ZFS raidz expansion by mustache_kimono on Monday January 20, 2025 @06:09AM (#42767433)
Re:ZFS 2.3.0 released with ZFS raidz expansion by hoherd on Tuesday January 14, 2025 @02:10PM (#42702209)
Online filesystem checking and repair.

Reading any file will tell you with 100% guarantee if it is corrupt or not.

Snapshots that you can `cd` into, so you can compare any prior version of your FS with the live version of your FS.

Block level compression.

Re:ZFS 2.3.0 released with ZFS raidz expansion by snvzz on Tuesday January 14, 2025 @09:36PM (#42706673)
>Reading any file will tell you with 100% guarantee if it is corrupt or not.

Only possible if it was not corrupted in RAM before it was written to disk.

Using ECC memory is important, irrespective of ZFS.