News for hackers. Stuff that matters.
Re:Proposal to move CoreOS off of btrfs by HorizonXP on Wednesday December 17, 2014 @07:12PM (#8765297)
Thank goodness. btrfs has bitten me way too often on CoreOS. I eventually succumbed to wiping the /var/lib/docker mounted directory on every reboot to minimize the occurrence of the low disk space issues, but nevertheless, issues still exist. Even today, I still have some cases where docker will complain about not being able to create the container/file, due to some inane error. I've had to reboot machines many times just to try to get it to cooperate. Furthermore, that solution of wiping the partition means that my machines need to redownload their docker images on every reboot, which means they come up more slowly than absolutely necessary.
Re:Proposal to move CoreOS off of btrfs by 23david on Wednesday December 17, 2014 @10:18PM (#8765827)
This is ridiculous. CoreOS is managing their own distro, so why not just package in ZFS and get it over with.

It's been how many years now waiting for the next great ZFS competitor? If nobody is able to improve on ZFS, how about we just all jump on the bandwagon and move on with our lives?

If nothing else, having more people using ZFS may inspire someone to actually improve on it. BTRFS has such a limited feature set in comparison to ZFS that with the advent of ZFS on Linux, it's really hard to understand the community's continued backing of BTRFS as the Linux community's CoW filesystem competitor to ZFS. Spend a few weeks using ZFS on Linux on a machine with a few SSDs and a few HDDs, or just enable it on a linux laptop with a SSD drive, and it's hard to go back to anything else.

Re:Proposal to move CoreOS off of btrfs by tacticus on Wednesday December 17, 2014 @11:23PM (#8765961)
Because sun decided to sabotage it when they released it and oracle haven't stepped back yet.
Re:Proposal to move CoreOS off of btrfs by throwaway90446 on Wednesday December 17, 2014 @11:25PM (#8765968)
Sabotage? How, exactly? I have heard of no major corruption or performance bugs in ZFS, what am I missing?
Re:Proposal to move CoreOS off of btrfs by ecnahc515 on Thursday December 18, 2014 @12:50AM (#8766157)
From http://zfsonlinux.org/faq.html#WhatAboutTheLicensingIssue

"ZFS is licensed under the Common Development and Distribution License (CDDL), and the Linux kernel is licensed under the GNU General Public License Version 2 (GPLv2). While both are free open source licenses they are restrictive licenses. The combination of them causes problems because it prevents using pieces of code exclusively available under one license with pieces of code exclusively available under the other in the same binary. "

Re:Proposal to move CoreOS off of btrfs by techdragon on Thursday December 18, 2014 @03:21AM (#8766443)
as others have said below. the CDDL or 'cuddle' license as some chose to pronounce it. Is incompatible with the GPL, which means two things.

1 - We can't just take the code and add it to the kernel. 2 - The patent and other legal grants in the licence won't apply if we try to reverse engineer a compatible GPL2 equivalent for the kernel to use, which will be a HUGE risk for the few companies that would probably consider the cost of reverse engineering worth it. And before you say it can be done without company support. I have 2 things to say, hows that going for the ReiserFS 4 fans who wanted to keep improving that, and in order to continue the work on ZFS effectively, the existing ZFS developers have 'ganged up' and now try to work on everything so that the openzfs project can be a single source of truth for the ZFS source code, and a reverse engineered version would be very unlikely to benefit from this, and would therefore require even more developer time just keeping up with the improvements 'upstream' in ZFS from the 'original' ZFS codebase.

Re:Proposal to move CoreOS off of btrfs by 23david on Wednesday December 24, 2014 @03:54AM (#8792165)

  In the case of the kernel, this prevents us from distributing ZFS as part of 
  the kernel binary. However, there is nothing in either license that prevents 
  distributing it in the form of a binary module or in the form of source code.
Source: http://zfsonlinux.org/faq.html#WhatAboutTheLicensingIssue

  ZFS cannot be added to Linux directly because the CDDL is incompatible with the GPL. 
  ZFS can, however, be distributed as a DKMS package separate from the main kernel package.
Source: https://wiki.ubuntu.com/ZFS

So why not just distribute the DKMS package with a distro? Easy enough. Will it ruin the user experience somehow?

Re:Proposal to move CoreOS off of btrfs by kbar13 on Thursday December 18, 2014 @12:07AM (#8766049)
licensing
Re:Proposal to move CoreOS off of btrfs by jeffdavis on Wednesday December 17, 2014 @11:25PM (#8765967)
The license for ZFS is still CDDL
Re:Proposal to move CoreOS off of btrfs by Gigablah on Wednesday December 17, 2014 @07:19PM (#8765327)
Yep. It's fun when your entire etcd cluster dies at the same time (because you started a global unit that pulls a huge docker container).

You'd think they have safeguards to automatically rebalance on certain conditions (metadata filling up, etc) but no, you have to babysit btrfs.

Re:Proposal to move CoreOS off of btrfs by saryant on Wednesday December 17, 2014 @10:52PM (#8765895)
I'm glad I'm not the only one with these problems. I was starting to think I was going crazy with my etcd+btrfs issues.
Re:Proposal to move CoreOS off of btrfs by 23david on Wednesday December 17, 2014 @11:24PM (#8765964)
hrm... what's the failure scenario here? Are there any good btrfs management utils that can help with running btrfs in prod?
Re:Proposal to move CoreOS off of btrfs by Shish2k on Wednesday December 17, 2014 @09:23PM (#8765705)
> Even today, I still have some cases where docker will complain about not being able to create the container/file, due to some inane error. I've had to reboot machines many times just to try to get it to cooperate.

I get those, and am not using btrfs...

Re:Proposal to move CoreOS off of btrfs by peteridah on Wednesday December 17, 2014 @10:33PM (#8765852)
yes this, I get those too and no btrfs
Re:Proposal to move CoreOS off of btrfs by Gigablah on Thursday December 18, 2014 @01:06AM (#8766193)
Re:Proposal to move CoreOS off of btrfs by sureshv on Wednesday December 17, 2014 @08:05PM (#8765482)
I've seen lots devicemapper failures running docker build on ext4 (AWS SSD EBS). Really painful to have to rebuild on failures since these issue seem to happen quite often.
Re:Proposal to move CoreOS off of btrfs by jaytaylor on Wednesday December 17, 2014 @10:59PM (#8765907)
I've been bitten badly by btrfs before as well.

I wish it were feasible to get CoreOS (and Docker, for that matter) to add support for ZFS. I use LXC + ZFS every day and it is stable, reasonably fast, and all around wonderful!!!

sigh.