News for hackers. Stuff that matters.
Re:Building a 30 PB storage cluster in the heart of SF by g413n on Wednesday October 01, 2025 @01:36PM (#45440564)
atm we don't and we're a bit unsure whether it's a free lunch wrt adding complexity. there's a really nice property of having isolated hard drives where you can take any individual one and `sudo mount` it and you have a nice chunk of training data, and that's something anyone can feel comfortable touching without any onboarding to some software stack
Re:Building a 30 PB storage cluster in the heart of SF by randomfinn on Wednesday October 01, 2025 @08:51PM (#45445325)
I wonder if snapraid would work for this. Especially if your data is mostly written once and then just read, it could be an easy way to add redundancy while keeping isolated individual drives.