News for hackers. Stuff that matters.
Re:FreeNAS: Open Source Storage Operating System by eric_the_read on Thursday August 25, 2016 @04:56PM (#12362442)
One thing that's been unclear to me with ZFS: How should I design a ZFS-based storage system for extensibility? From what I've read, it seems like you can't add devices to a pool once it's been created. I'd love to create a small-ish NAS right now to store, say, the top 10% of my blu-ray collection, and then incrementally upgrade it over time as I get funds.
Re:FreeNAS: Open Source Storage Operating System by yoasif_ on Thursday August 25, 2016 @05:37PM (#12362702)
The easiest way to do this is to use mirror vdevs, that way you can add disks two at a time. Of course, you miss out on RAIDZ functionality that way, but that's the simplest setup.

I've gone ahead and actually created a new array using btrfs raid10 instead (with an eye towards a RAIDZ2/3 like configuration whenever the btrfs guys get around to fixing it); btrfs allows for online reshaping of the mirroring configuration, so it doesn't have the limitations of ZFS in this instance.

Re:FreeNAS: Open Source Storage Operating System by iberinger on Thursday August 25, 2016 @06:41PM (#12363061)
Agreed, mirror vdevs are the way to go. Here's a post that explains the tradeoffs between RAIDZ and mirror vdevs in great detail: http://jrs-s.net/2015/02/06/zfs-you-should-use-mirror-vdevs-...
Re:FreeNAS: Open Source Storage Operating System by voltagex_ on Friday August 26, 2016 @08:26AM (#12365689)
I'm still not sure what setup I have. I really should have written down every decision I've made while building my NAS (I think I've now found articles that disagree with every single choice I made)

    $ zpool status
  pool: BoxODisks
 state: ONLINE
      scan: scrub repaired 0 in 9h20m with 0 errors on Sun Jul 31 01:31:31 2016
    config:

        NAME                                            STATE     READ WRITE CKSUM
        BoxODisks                                       ONLINE       0     0     0
          mirror-0                                      ONLINE       0     0     0
            gptid/18059e22-b6a4-11e5-9cca-0cc47a6bbf34  ONLINE       0     0     0
            gptid/194649b1-b6a4-11e5-9cca-0cc47a6bbf34  ONLINE       0     0     0
          mirror-1                                      ONLINE       0     0     0
            gptid/1a86b3cc-b6a4-11e5-9cca-0cc47a6bbf34  ONLINE       0     0     0
            gptid/1bcd3ad6-b6a4-11e5-9cca-0cc47a6bbf34  ONLINE       0     0     0
        cache
          diskid/DISK-S24ZNWAG903847Lp1                 ONLINE       0     0     0

I think I have mirrored vdevs.

What does that mean for replacing failed disk/s? What does that mean when I want to upgrade to 8TB drives? The biggest "mistake" I made was buying a very expensive 4 bay enclosure - 4 drives is not enough.

Re:FreeNAS: Open Source Storage Operating System by rleigh on Sunday August 28, 2016 @10:35AM (#12376673)
When you want to upgrade, you can offline and replace each disk, then resilver, in turn. If the pool is set to autoexpand, you'll eventually get a total capacity of 16TB. You can do this for all the disks, or for each mirror separately in two groups of two.
Re:FreeNAS: Open Source Storage Operating System by otterpro on Thursday August 25, 2016 @06:01PM (#12362837)
I agree that mirror is the best (i.e. simple and easy) way to do it, and to avoid raid-greed (http://constantin.glez.de/blog/2010/01/home-server-raid-gree...). Mirror (vs Raid-Z) gives us better fault-tolerance and flexibility.
Re:FreeNAS: Open Source Storage Operating System by eric_the_read on Thursday August 25, 2016 @05:45PM (#12362750)
Can you do btrfs with FreeNAS? I didn't think that was available.
Re:FreeNAS: Open Source Storage Operating System by yoasif_ on Thursday August 25, 2016 @06:01PM (#12362836)
No, you have to go with Linux. I'm using the latest Ubuntu server LTS (since ZFS is also included, and because I'm familiar with Ubuntu).

I don't have experience with FreeNAS unfortunately.

Re:FreeNAS: Open Source Storage Operating System by jmporcel on Thursday August 25, 2016 @06:17PM (#12362928)
If you could, that makes no sense. ZFS is superior.
Re:FreeNAS: Open Source Storage Operating System by cyphar on Thursday August 25, 2016 @11:46PM (#12364130)
Unless you want to reshape your array. Then md-raid is superior. Btrfs's raid implementation has had some pretty bad issues recently and has been declared "experimental" as a result.
Re:FreeNAS: Open Source Storage Operating System by yoasif_ on Friday August 26, 2016 @07:57AM (#12365569)
This is inaccurate. Raid56 have always been labeled experimental, but recently, data corruption bugs were found which make it dangerous to use.

Other raid levels (raid0, raid1, raid10) work fine and are considered stable -- at least as stable as the filesystem itself.

Either way, if you care about the data, you must backup, no matter what fs you use.

Re:FreeNAS: Open Source Storage Operating System by cyphar on Friday August 26, 2016 @10:01AM (#12366295)
Apologies, I only saw the recent mailing list post which basically said "we're removing the ability to even compile support for raid56". I didn't mean to say that btrfs was overly-zealous in their trust of new code (I personally am super excited for the future of btrfs).
Re:FreeNAS: Open Source Storage Operating System by qwertyuiop924 on Thursday August 25, 2016 @05:22PM (#12362606)
Re:FreeNAS: Open Source Storage Operating System by eric_the_read on Thursday August 25, 2016 @05:45PM (#12362746)
Yeah, I saw that before, but that isn't quite what I wanted, if I'm reading it right. That tells me how to replace all the drives in my array with new ones; I'd prefer to (for instance) start with 4x 4TB drives, and add new ones as my storage needs build up.
Re:FreeNAS: Open Source Storage Operating System by qwertyuiop924 on Thursday August 25, 2016 @07:03PM (#12363159)
Re:FreeNAS: Open Source Storage Operating System by eric_the_read on Friday August 26, 2016 @10:13AM (#12366373)
Nice! Thanks for that.
Re:FreeNAS: Open Source Storage Operating System by qwertyuiop924 on Friday August 26, 2016 @12:05PM (#12367154)
I don't know if that works on OpenZFS, though. Probably.
Re:FreeNAS: Open Source Storage Operating System by wtallis on Thursday August 25, 2016 @05:08PM (#12362535)
You can expand a pool one RAID array at a time, but growing one drive at a time isn't really possible except by not using RAID; ZFS doesn't have a true equivalent to the BTRFS rebalance operation.
Re:FreeNAS: Open Source Storage Operating System by snvzz on Thursday August 25, 2016 @05:06PM (#12362508)
You can add vdev to pool anytime. Removing them is not as easy, so some planning is necessary.
Re:FreeNAS: Open Source Storage Operating System by eric_the_read on Thursday August 25, 2016 @05:48PM (#12362762)
For others, I found this, explaining the process: http://alp-notes.blogspot.com/2011/09/adding-vdev-to-raidz-p...

Downside is, you lose a significant chunk of storage (the author measured > 20%), but you can add new storage to a pool online.