Building a 30 PB storage cluster in the heart of SF

Re:Building a 30 PB storage cluster in the heart of SF by yread on Wednesday October 01, 2025 @02:37PM (#45441476)

You could get pretty close to the cost 1$/TB/month using Hetzner's sx135 with 8x22TB so 140TB in raidz1 for 240 eur. Maybe you get a better rate if you rent 200 of them. Someone else takes care of a lot of risks and you can sleep well at night

[ Parent | on HN ]

Re:Building a 30 PB storage cluster in the heart of SF by nodja on Wednesday October 01, 2025 @02:52PM (#45441702)

I don't think Hetzner provides locations in SF. Those 100GBit connections don't do much if they need to connect outside the city the rest of the equipment is in, but maybe peering has gotten better and my views are outdated.

[ Parent | on HN ]

Re:Building a 30 PB storage cluster in the heart of SF by fuzzylightbulb on Wednesday October 01, 2025 @05:09PM (#45443581)

You're good. The speed of light through a glass fiber is still just as slow as it ever was.

[ Parent | on HN ]

Re:Building a 30 PB storage cluster in the heart of SF by g413n on Wednesday October 01, 2025 @03:03PM (#45441825)

yeah it's totally plausible that we go with something like this in the future. We have similar offers where we could separate out either the financing, the build-out, or both and just do the software.

(for Hetzner in particular it was a massive pain when we were trying to get CPU quotas with them for other data operations, and we prob don't want to have it in Europe, but it's been pretty easy to negotiate good quotes on similar deals locally now that we've shown we can do it ourselves)

[ Parent | on HN ]

Re:Building a 30 PB storage cluster in the heart of SF by mx7zysuj4xew on Wednesday October 01, 2025 @05:52PM (#45443973)

You cannot use hetzner for anything serious.

They'd most likely claim abuse and delete your data wholesale without notice

[ Parent | on HN ]

Re:Building a 30 PB storage cluster in the heart of SF by fapjacks on Thursday October 02, 2025 @10:39AM (#45450239)

100% this. Hetzner has no problems completely blowing away whatever you've got running for arbitrary reasons. And their support is incresibly bad.

[ Parent | on HN ]

Re:Building a 30 PB storage cluster in the heart of SF by lostmsu on Friday October 03, 2025 @02:21PM (#45466045)

Your math does not math. It is more like $2/TB/month with minimal redundancy.

[ Parent | on HN ]