This is 1080 TB (in 12 TB disks) in one server under ZFS:
https://vermaden.wordpress.com/2019/06/19/freebsd-enterprise...
For 100 TB you would get smaller server, like 2U with 12 slots filled with 10/12/14 TB disks for your 'usable' 100 TB space.
For more ZFS and/or FreeBSD storage options check this:
https://vermaden.wordpress.com/2020/02/12/freebsd-enterprise...
Hope that helps.
Regards.
I'm surprised you went with one single HDD model. Don't people normally say "Go for different HDDs from different manufacturers, so that in case of manufacturing defects not all HDDs will break at the same time"?
You can slice and dice the drives however you like. I found this guy's blog posts to be useful for running a homegrown NAS:
- https://louwrentius.com/should-i-use-zfs-for-my-home-nas.htm...
- https://louwrentius.com/the-hidden-cost-of-using-zfs-for-you...
"It seems though that the one URE in 10^14^ bits (an error every 12.5 TB of data read) is a worst-case specification. In real life, drives are way more reliable than this specification."
I don't believe that statement without data backing it up.
Disk drives are right at the engineering edge. There is a reason why consumer class drives have one MTBF and enterprise drives have a better MTBF. If a disk drive manufacturer could somehow cite a better MTBF, they absolutely would (see the whole GB vs GiB marketing stupidity, for example).
If you plan on using ZFS, make sure to take into account for the overhead and parity drives. For example, I have 12x 16TB (192TB raw) drives in raidzfs2, including overhead and parity I only have ~125TiB usable.
I’ve got a couple of projects I’d like to do that require maybe 100TB of storage: some scientometrics against the sci-hub collection, as well as building a bajillion scala projects from github. I don’t really care about data redundancy.
The cheapest way I’ve been able to figure out to do this is just buy a case with 15 HDD bays, eg the Anidees AI crystal case, and just get a ridiculously beefy processor + 256gb RAM and do all the computation on a single box.
Does this sound right? All of the purchasable NAS cases all seem more expensive, but I’m out of my element.
I expect I’m going to want to figure out ZFS to make a single logical drive.
Does this seem right? Building eg a backblaze pod is outside of my budget, and my eyes glaze over whenever I try to read about NAS controllers.