News for hackers. Stuff that matters.
Re:The potential risk to ZFS created by the shift in its use... by dspillett on Monday January 28, 2019 @11:41AM (#19018848)
BTRFS is being positioned as an alternative to ZFS (amongst others) without the licensing issues (and less rational concerns like the current/past politics of it all), so perhaps there is a "why do we X it when Y is close" with a bit of extra NIH syndrome mixed in?
Re:The potential risk to ZFS created by the shift in its use... by DiabloD3 on Monday January 28, 2019 @12:42PM (#19019369)
Oracle discontinued BTRFS development when they bought Sun, merged the ZFS and BTRFS team, and then fired anyone on the BTRFS team that didn't have ZFS experience.

BTRFS is basically on maintenance mode, and no one at Redhat/IBM or Ubuntu has any interest in keeping it alive. Anyone that requires HA services will not be using BTRFS.

Redhat ships with XFS as the default file system, Ubuntu ships with Ext4 as default with heavy install-time ZFS support for enterprise storage, and BTRFS is no longer being spoken of by anyone as a potential Ext5 candidate.

Re:The potential risk to ZFS created by the shift in its use... by cmurf on Monday January 28, 2019 @02:12PM (#19020171)
90% of this is wrong. Oracle bought Sun in 2009, and continued to make substantial contributions for years after that, and they still have developers actively contributing to Btrfs. The idea they merged the ZFS and Btrfs teams is absurd, the two file systems are nothing alike either in terms of design, on disk format, or code base.

Btrfs is on maintenance mode? Based on what evidence? There's 1k-2k commits per kernel cycle. There are dozens of developers actively working on it. Facebook is certainly using it in production for high availability in concert with Gluster FS, they're also using Btrfs almost exclusively with Tupperware, their containerization service.

Red Hat has quite a lot of device mapper, LVM, and XFS developers so it makes sense for them to work on storage solutions that continue to build on that. And Red Hat hasn't been significantly contributing to Btrfs for many years now, so their lack of interest isn't new and hasn't affected Btrfs development.

Re:The potential risk to ZFS created by the shift in its use... by cthalupa on Monday January 28, 2019 @02:33PM (#19020326)
>The idea they merged the ZFS and Btrfs teams is absurd, the two file systems are nothing alike either in terms of design, on disk format, or code base.

You've never seen the same team working on two very separate code bases or products?

I have no idea if the btrfs and zfs teams at Oracle were merged, but I don't know that "they are two separate products" is actually a real argument that they weren't. Product teams working on separate things get merged all the time.

Re:The potential risk to ZFS created by the shift in its use... by cmurf on Monday January 28, 2019 @03:37PM (#19020846)
I've seen a tiny handful of developers juggle more than one file system at a time. They're that complicated. I'm familiar with most of the Btrfs developers and can't think of a single one who works on ZFS; the most active developers when asked about it quite a few years ago on the Btrfs development list said they were unfamiliar with ZFS and it wasn't used as a guide for Btrfs.

You can track developers through their git commits, and you'll see even when they change companies, they almost invariably keep working on the same filesystem they were before the move. Which is why the idea that Red Hat has no one working on Btrfs, means they want to see it go away is not what's going on at all. They have a lot of other developers already, who'd lose years becoming familiar with Btrfs (or ZFS for that matter). So you're going to see them build on what they already are familiar with, rather than moving laterally to a filesystem technology they're not familiar with.

Re:The potential risk to ZFS created by the shift in its use... by gst on Monday January 28, 2019 @01:00PM (#19019525)
Is it in maintenance mode? Chris Mason (the main btrfs developer) works for Facebook now and Facebook uses btrfs on "millions of servers" (source: https://code.fb.com/open-source/linux/).
Re:The potential risk to ZFS created by the shift in its use... by DiabloD3 on Monday January 28, 2019 @01:25PM (#19019744)
Facebook's usage of it is very specific, but as you mentioned, Chris Mason (who used to also work at Oracle on their BTRFS team before Oracle dumped BTRFS) is there in-house to make sure it is smooth.

However, I'm pretty sure if I boiled the commit history down for the kernel, most of Facebook's commits would be Flashcache, and not BTRFS.

What I forgot, though, is SuSE supports it as their enterprise FS of choice, which is maybe more important than Facebook.

Re:The potential risk to ZFS created by the shift in its use... by cookiecaper on Monday January 28, 2019 @09:42PM (#19023263)
Yes. It's important to recognize that there's a big difference in one's willingness to adopt a technology if its creator is on staff. Chris Mason's full-time job is to make sure the thing he built works well for his employer.

If you work some place that doesn't have that kind of luxury, perhaps a little extra conservatism is warranted before you go deploying across "millions of servers".

Re:The potential risk to ZFS created by the shift in its use... by CrLf on Monday January 28, 2019 @12:11PM (#19019104)
Isn't btrfs also at risk? I was under the impression that it lost some steam in the recent past and was on its way to become the next Hurd.
Re:The potential risk to ZFS created by the shift in its use... by vetinari on Monday January 28, 2019 @12:26PM (#19019233)
btrfs has a problem with it's image as being unreliable (some well deserved). Redhat obsoleted it, because they use kernel 3.10 in RHEL7 and they were doing nothing but backporting, without having any btrfs expertise in house anyway. Btrfs continues to be developed by Oracle, Suse, Facebook, Fujitsu and the rest of the usual suspects.
Re:The potential risk to ZFS created by the shift in its use... by walrus01 on Monday January 28, 2019 @01:33PM (#19019823)
RHEL is famous for using kernels that are ancient, even by the notoriously conservative and risk averse debian-stable standards.

I can't even imagine the hassle of backporting stuff from much newer kernels into 3.10 to make btrfs work.

If you want to use btrfs in production (not the best idea, IMHO, but orgs such as facebook do it) you absolutely need to be running a 4.9.x or better kernel.

Re:The potential risk to ZFS created by the shift in its use... by snuxoll on Monday January 28, 2019 @04:19PM (#19021184)
Calling them ancient is a bit unfair, they regularly backport hardware support and select other features from newer kernels. Unlike other distributions, however, they have a stable kernel ABI for an entire release, so they can’t bring in changes that break white listed symbols.
Re:The potential risk to ZFS created by the shift in its use... by KaiserPro on Monday January 28, 2019 @02:53PM (#19020483)
The reason why its not taken off is that its much younger than ZFS, and more crucially its got terrible admin tools and documentation.

It might be a brilliant file system, but I'm never going ot use it because its such an arse to learn how to use it properly.

Re:The potential risk to ZFS created by the shift in its use... by 6c696e7578 on Monday January 28, 2019 @03:45PM (#19020907)
The Oracle Linux SAG is a reasonable place to start for documentation on it:

https://docs.oracle.com/cd/E52668_01/E54669/html/ol7-about-b...

However, I often end up at the Arch Linux wiki, too:

https://wiki.archlinux.org/index.php/btrfs

Re:The potential risk to ZFS created by the shift in its use... by ajross on Monday January 28, 2019 @12:31PM (#19019265)
Not that I've seen. It's there and works. I think a lot of that impression is driven by the fact that... let's be honest: filesystem features are stale, dinosaur stuff. All the cool kids are worrying about cloud scale storage backends.

At the end of the day btrfs and ZFS both are just ways to help single-system administrators do better and more reliable backups. I know that's not how they're positioned, but really that's all they do.

Re:The potential risk to ZFS created by the shift in its use... by r1ch on Monday January 28, 2019 @12:42PM (#19019371)
btrfs still has a lot of issues unfortunately. I tried using buildroot once and the entire filesystem kinda died with the infamous "out of space" error even though there was plenty free. Several RAID levels are also unsafe to use. After experiencing both, I trust ZFS a lot more.
Re:The potential risk to ZFS created by the shift in its use... by Dylan16807 on Monday January 28, 2019 @06:28PM (#19022145)
I've only used BTRFS a handful of times and I've still had three filesystems die on me. Two became cripplingly slow, probably because of automatic snapshots (even though there was a small retention limit). One was fine until it suddenly got into a state where it can only be mounted read-only or mounting never finishes, despite a lot of parameters thrown at it trying to fix that. The first two were not terribly long ago, and the last one was 2018.
Re:The potential risk to ZFS created by the shift in its use... by shanemhansen on Monday January 28, 2019 @07:01PM (#19022406)
I had the same experience with btrfs. It killed my machine multiple times.

ZFS on my laptop took me an evening to setup, but it's been completely hassle free. ZFS is really easy to use.

Re:The potential risk to ZFS created by the shift in its use... by petre on Monday January 28, 2019 @01:14PM (#19019661)
Agreed. However, Synology uses it in their NAS products along with md RAID. Also, SuSE ships it in all their products. OpenSuSE LEAP 15 which was released two weeks ago and has a transactional updates feature that uses btrfs snapshots.
Re:The potential risk to ZFS created by the shift in its use... by yellowapple on Monday January 28, 2019 @10:34PM (#19023506)
Honestly, I've never really understood the appeal of trying to shoehorn RAID into the FS itself. A more traditional softraid has always felt "good enough" to me (especially in this day and age of affordable SSDs).

ZFS in particular seems to push more toward RAIDZ, whereas I'm a bit averse to striping in general nowadays for data recovery/reliability reasons (RAID1 + JBOD is dead-simple to recover, more flexible with heterogeneous disk sizes, and much easier to reason about IMO).

Re:The potential risk to ZFS created by the shift in its use... by GalacticDomin8r on Tuesday January 29, 2019 @12:05AM (#19023913)
Not sure where you are getting the push from to use RAIDZ over mirroring. Definitely not from ZFS proper. It's all about what's the best for the situation. Most my things are ZFS mirrors. But given a choice between RAID 3/5/6 or RAIDZ, I don't have to think long.
Re:The potential risk to ZFS created by the shift in its use... by emikulic on Tuesday January 29, 2019 @09:28PM (#19032082)
I've had the opposite experience. I've been using btrfs for years with no issues (pro-tip: don't create 10,000 snapshots and then try to rebalance the fs)

Having snapshots has saved me occasionally and find-new is really useful.

Re:The potential risk to ZFS created by the shift in its use... by paulie_a on Monday January 28, 2019 @01:59PM (#19020087)
Maybe, but with btrfs your data is definitely at risk. Don't ever use it for anything important. Backups are important but even with those, btrfs is a filesystem that should be uninvented.
Re:The potential risk to ZFS created by the shift in its use... by kzrdude on Monday January 28, 2019 @01:14PM (#19019659)
It's installed an works many places so it's not quite Hurd.
Re:The potential risk to ZFS created by the shift in its use... by the8472 on Monday January 28, 2019 @05:06PM (#19021530)
A critical issue is that btrfs raid5/6 is officially considered unstable.