News for hackers. Stuff that matters.
Re:An Introduction to ZFS by gh02t on Friday November 20, 2020 @09:06AM (#25160523)
ZFS can use that many drives, but it's not a distributed filesystem so it's intended to use within a single server. For 100 disks (or some arbitrarily large number) I'd assume you want something distributed, in which case ZFS could serve as the underlying FS on each node with e.g. Gluster or Ceph. ZFS as the backing store for Gluster is fairly common, for example.
Re:An Introduction to ZFS by secabeen on Friday November 20, 2020 @11:52AM (#25162242)
I have two systems with 140 drives in a single ZFS pool. (14 VDEVS of 10 drives each). They work great, and we haven't had any issues with them.
Re:An Introduction to ZFS by tutfbhuf on Friday November 20, 2020 @12:04PM (#25162383)
What type of connection do these system have (e.g. 10GbE) and how much latency? Would it be possible to span a ZFS Pool across multiple regions (us, europe, ...)?
Re:An Introduction to ZFS by secabeen on Friday November 20, 2020 @12:55PM (#25162981)
The two systems are in different buildings on campus. Each system (with 140) drives is a single unit, with 60-drive JBODs running on SAS-external connections.

If you want to span a pool across multiple regions, you'll want a distributed file system on top of your ZFS to manage that. Something like Lustre or Ceph. It would still be very challenging, though.