Re:Why Fugaku, Japan's fastest supercomputer, went virtual o...
by littlestymaar on Friday April 19, 2024 @02:20PM
(#40090278)
> its not a fallacy, its a tradeoff. If you want to have 100nodes doing batch work in a datacentre, you need to buy, install, commission and monitor hardware, storage and networking.
The fallacy is that it costs zero staff. But in reality it doesn't, it reduces the amount of staff you need, but only to an extend, because you still need plenty of people to run and monitor your cloud infra.
> Yes, but we are talking about an HPC cluster that is >100k nodes.
It is also much higher requirements than anything AWS is used to run, so you either have the know-how in house or don't have it at all.
> Second tier cloud providers are rarely able to provide 10k GPUs on the spot,
If you need 10k GPUs on the spot, then you have a serious planning issue… I know that many companies have incompetent management, but that's not the kind of thing you're supposed to brag about in an internet discussion. And using AWS to cope with management and planning deficiency is only going to get you this far, at some point you'll need to address them eventually.
The fallacy is that it costs zero staff. But in reality it doesn't, it reduces the amount of staff you need, but only to an extend, because you still need plenty of people to run and monitor your cloud infra.
> Yes, but we are talking about an HPC cluster that is >100k nodes.
It is also much higher requirements than anything AWS is used to run, so you either have the know-how in house or don't have it at all.
> Second tier cloud providers are rarely able to provide 10k GPUs on the spot,
If you need 10k GPUs on the spot, then you have a serious planning issue… I know that many companies have incompetent management, but that's not the kind of thing you're supposed to brag about in an internet discussion. And using AWS to cope with management and planning deficiency is only going to get you this far, at some point you'll need to address them eventually.