News for hackers. Stuff that matters.
Re:Building a 30 PB storage cluster in the heart of SF by g413n on Wednesday October 01, 2025 @04:29PM (#45443042)
When I was working at sfcompute prior to this we saw multiple datacenters literally catch on fire bc the industry was not experienced with the power density of h100s. Our training chips just aren't a standard package in the way JBODs are.
Re:Building a 30 PB storage cluster in the heart of SF by Symbiote on Wednesday October 01, 2025 @05:57PM (#45444027)
Isn't the easy option to spread the computers out, i.e. not fill the rack, but only half of it?

A GPU cluster next to my servers has done this, presumably they couldn't have 64A in one rack so they've got 32A in two. (230V 3phase.)

Re:Building a 30 PB storage cluster in the heart of SF by pixl97 on Wednesday October 01, 2025 @06:29PM (#45444351)
Rackspace is typically at a premium at most data centers.
Re:Building a 30 PB storage cluster in the heart of SF by Symbiote on Wednesday October 01, 2025 @06:39PM (#45444447)
I'm more surprised that a data centre will apparently provide more power to a rack than is safe to use.
Re:Building a 30 PB storage cluster in the heart of SF by toast0 on Thursday October 02, 2025 @03:21AM (#45447097)
My info may be dated, but power density has gone up a ton over time. I'd expect a lot of datacenters to have plenty of space, but not much power. You can only retrofit so much additional power distribution and cooling into a building designed for much less power density.
Re:Building a 30 PB storage cluster in the heart of SF by tempest_ on Thursday October 02, 2025 @09:40AM (#45449466)
This is my experience as well. We have 42u racks with 8 machines in them because we cant get more power circuits to the rack.
Re:Building a 30 PB storage cluster in the heart of SF by g413n on Thursday October 02, 2025 @11:14AM (#45450816)
yep this was the case for us.
Re:Building a 30 PB storage cluster in the heart of SF by lemonlearnings on Wednesday October 01, 2025 @06:49PM (#45444551)
Adding the compute story would be interesting as a follow up.

Where is that done? How many GPUs do you need to crunching all that data. Etc.

Very interesting and refreshing read though. Feels like what Silicon Valley is more about than just the usual: tf apply then smile and dial.