I've never seen a clustered filesystem that was friendly or simple enough for the small office / home use case. With ZFS I pile a bunch of disks in a server, run samba on it, and there you go. Still, best of luck if you try it.
Only problem with ZFS for budget/home use as I see it, is the inability to grow zpools (add a disk to get more space on an existing filesystem). Basically the the design is more "buy what you need (eg: 4x2TB), then replace (eg: 4x4TB as prices come down) -- and throw away your old disks".
I have a "two generation" setup; nominally 4x1TB + 4x2TB (though one of the disks in the latter raidz is actually 4TB because I had to replace a failed 2TB disk). It's gone fairly well so far; 8 disks + 1 for the OS is about all I can fit in an ordinary PC, and I didn't feel too bad about throwing away 500GB disks to replace them with 2TB ones; replacing the 1TB disks with 4TB ones will be the same.
Wouldn't "add more disks to get more space" also be a problem due to physical limitations on home computer style machine (even if ZFS allowed that).
At some point 2 older towers or hardware with only 4 drive bays might be cheaper than one motherboard and server tower that takes 8 or 12 drives.
That is why I was wondering about the clustered/distributed FS option.
If you're building something today, and get an avoton board, you'll have 10+sata ports on the board. I don't know what kind of midi-tower only support 4x 3.5" drives -- maybe you're thinking hot-swap, front-accessible?
If you get a full tower, you should be able to fit a couple of (or equivalent): http://www.newegg.com/Product/Product.aspx?Item=N82E16817198...
(3.5" & 5.25" Black Tray-less 5 x 3.5" HDD in 3 x 5.25" Bay SATA Cage) in front -- if yo feel you need front-accessible drives.
I'd say you normally want less boxes to take care of (even if failure will be more catastrophic) on such a small scale. Depends on what you need of course.
Well, performance. If you need IOPS, every network based storage will be far slower. And a whole lot more gotchas in terms of setup.
Is there any reason why one might choose that for a small office / home office setup instead of ZFS? Would it make setup/expansion easier.
Taking it in another direction.
I've been following this LeoFS project which basically replicates Amazon's S3 storage (so any S3 clients can work with it).
http://leo-project.net/leofs/
Its claim is one can add nodes to the cluster to expand its storage capability. Given enough physical space it might be cheaper to find 3-4 machines (towers) with 4 drive bays than building one new server with 12+ bays. Then use linux's fuse client to access it.