News for hackers. Stuff that matters.

A comment on We saved millions in SSD costs by upgrading our filesystem. Parent comment

Re:We saved millions in SSD costs by upgrading our filesystem by dilyevsky on Tuesday November 09, 2021 @07:03PM (#29169287)
HDFS supports RS/XOR erasure coding which gives you same fault tolerance guarantees as 3x at much lower replication factor. This is essentially the same method aws/gcp use under the hood - there’s no magic involved here
[ Parent | on HN ]
Re:We saved millions in SSD costs by upgrading our filesystem by genewitch on Tuesday November 09, 2021 @11:15PM (#29171033)
Can I use this over NFS or samba or is it just for Java and Hadoop?
[ Parent | on HN ]
Re:We saved millions in SSD costs by upgrading our filesystem by dilyevsky on Wednesday November 10, 2021 @12:35AM (#29171434)
Yes you can* for new projects I would go with ceph+nfsv4

*) https://hadoop.apache.org/docs/r2.8.0/hadoop-project-dist/ha...

[ Parent | on HN ]
Re:We saved millions in SSD costs by upgrading our filesystem by genewitch on Sunday November 14, 2021 @04:23PM (#29220855)
ceph+nfs was actually what i was going to do.

Probably some learning pains but at least i don't have to "lose" half my storage because the sizes aren't paired with anything.

[ Parent | on HN ]