Re:Oracle built a 1,060 node Raspberry Pi cluster
by tra3 on Thursday November 21, 2019 @03:33PM
(#21599273)
Software RAID = simple. At least when I built this machine nearly 10 years ago. Since then it's been rock solid, if not blazing fast. There were also horror stories of hardware raids failing due to controllers failing; or subtle differences between different revisions of RAID controllers. That said I also had budgetary restrictiions at the time that made software raid attractive.
I looked at NAS appliances, but I think it's still cheaper to create one from scratch (assuming existing knowhow, and "free" time :)
Re:Oracle built a 1,060 node Raspberry Pi cluster
by ComputerGuru on Thursday November 21, 2019 @03:17PM
(#21599040)
ZFS is 100% software raid.
Re:Oracle built a 1,060 node Raspberry Pi cluster
by whalesalad on Thursday November 21, 2019 @03:19PM
(#21599064)
Sorta. At the end of the day, yes, the disks are being managed by your CPU and not a dedicated raid controller... but it's a completely different ballgame than something like mdadm.
Re:Oracle built a 1,060 node Raspberry Pi cluster
by ownagefool on Thursday November 21, 2019 @04:05PM
(#21599610)
Not "sorta", it's software raid and thus, like software raid, it's portable to any system that'll run the software and JBOD the drives.
Most would argue RAIDZ is better, but many of these reasons are functionality based over and about just redundancy, i.e. Copy on Write, et all.
Re:Oracle built a 1,060 node Raspberry Pi cluster
by GhettoMaestro on Thursday November 21, 2019 @07:03PM
(#21601153)
Friends don't let friends create RaidZ pools.
Bite the bullet of the cost of N*2 mirrors.
Re:Oracle built a 1,060 node Raspberry Pi cluster
by whalesalad on Thursday November 21, 2019 @04:23PM
(#21599790)
I say sorta because in most circles when one is speaking of 'software RAID' they are referring to a very specific configuration and are explicitly not referring to ZFS.
Re:Oracle built a 1,060 node Raspberry Pi cluster
by colejohnson66 on Thursday November 21, 2019 @03:55PM
(#21599497)
ZFS doesn’t support hardware RAID controllers?
Re:Oracle built a 1,060 node Raspberry Pi cluster
by whalesalad on Thursday November 21, 2019 @04:22PM
(#21599775)
It supports it, but ZFS itself is operating on the host CPU, not the RAID controller. Additionally, ZFS prefers that the RAID controller is disabled/defeated and operating in JBOD mode where disks are passed-thru to the OS without any caching.
Re:Oracle built a 1,060 node Raspberry Pi cluster
by ComputerGuru on Thursday November 21, 2019 @10:34PM
(#21602192)
Not just caching. The problem is that non-JBOD HBAs also swallow error codes and mask retries, meaning ZFS is potentially unaware of some read errors and is not in control of the latency as the controller firmware has its own timeouts and retry counters. Moreover, most will not pass through SMART or else fake it.
Re:Oracle built a 1,060 node Raspberry Pi cluster
by icefo on Thursday November 21, 2019 @05:54PM
(#21600645)
Not a Pi but the rockpro64 has a pcie port in which you can plug what you want (a sata card for example).
I made a nas with one 3tb drive and zfs. Zfs was a bit difficult to install but now it works really well and the power consumption is low.
You have to use the Linux images mades by ayufan (a third party) though. The manufacturer just list a bunch of distro that run on the cards and most of them seem to be made by some volunteer. I'm not a big fan of that.
Re:Oracle built a 1,060 node Raspberry Pi cluster
by jacquesm on Thursday November 21, 2019 @06:50PM
(#21601068)
There is nothing wrong with software raid. Synology uses SW raid in all their NAS products as far as I know, right up to the flagship models with > 10 drives and 100T+ of storage.
Re:Oracle built a 1,060 node Raspberry Pi cluster
by imtringued on Friday November 22, 2019 @04:21AM
(#21604097)
Hardware raid controllers are a single point of failure and when they fail the vendor sells a different product so you will always have to stock up and buy two at once.
I can't think of any good reason to do use software RAID, let alone doing so on a Raspberry Pi. I would recommend hardware RAID, ZFS, or a Synology appliance.
If performance is truly not a concern, yes it is possible to do this with a Pi but I don't think you are going to be super impressed.