Re:New Compute Engine A2 VMs–First Nvidia Ampere A100 GPUs i...
by boulos on Tuesday July 07, 2020 @02:28PM
(#23762418)
Right. I’m not saying you can’t, but I am saying that when someone goes to their IT team and says “Hey, we want to buy a few of these” they’ll get met with a groan :).
Did you move all your other gear into Colovore? (That’s one of the challenges, you often need to be close to the rest of your systems / data)
Re:New Compute Engine A2 VMs–First Nvidia Ampere A100 GPUs i...
by tedivm on Tuesday July 07, 2020 @07:52PM
(#23765599)
We have a gigabit pipe to AWS and a local NAS for data caching.
Re:New Compute Engine A2 VMs–First Nvidia Ampere A100 GPUs i...
by cardine on Tuesday July 07, 2020 @03:10PM
(#23762895)
We have a similar situation to yours and have had a very positive experience with Colovore.
We also run at 100% utilization 24/7 and frequently use the cloud for burst before we go out and buy more cards/servers.
Colovore was super easy to get up and running and we will save at a minimum hundreds of thousands of dollars with this setup over exclusively using cloud instances.
We're in Colovore, which has a fantastic power density and is running roughly 1000k DGXs in their datacenter. It really wasn't all that difficult to get up and running. For us it made total sense, but we utilize physical hardware completely and have to scale into the cloud fairly regularly.