Building a 30 PB storage cluster in the heart of SF

Re:Building a 30 PB storage cluster in the heart of SF by tarasglek on Wednesday October 01, 2025 @01:56PM (#45440853)

i am still confused what their software stack is, they dont use ceph but bought netapp, so they use nfs?

[ Parent | on HN ]

Re:Building a 30 PB storage cluster in the heart of SF by OliverGuy on Wednesday October 01, 2025 @01:59PM (#45440884)

The NetApps are just disk shelves, can plug it into a SAS controller and use whatever software stack you please.

[ Parent | on HN ]

Re:Building a 30 PB storage cluster in the heart of SF by tarasglek on Wednesday October 01, 2025 @02:01PM (#45440926)

but they have multiple head nodes, so its some distributed setup or just active/passive type thing?

[ Parent | on HN ]

Re:Building a 30 PB storage cluster in the heart of SF by hnav on Wednesday October 01, 2025 @02:09PM (#45441053)

I'm guessing the client software (outside the dc) is responsible for enumerating all the nodes which all get their own IP.

[ Parent | on HN ]

Re:Building a 30 PB storage cluster in the heart of SF by nee1r on Wednesday October 01, 2025 @09:29PM (#45445528)

We have a custom barebones solution that uses a hashring to route the files!

[ Parent | on HN ]

Re:Building a 30 PB storage cluster in the heart of SF by toast0 on Thursday October 02, 2025 @03:37AM (#45447173)

I think each rack is one head node and several disk shelves (10?). No dual headed shelves.

[ Parent | on HN ]