Re:Score matching with Langevin Sampling: a new contender to...
by p1esk on Friday September 04, 2020 @01:10AM
(#24371878)
AWS is tricky in terms of how storage is provisioned - I don't remember details, but it's easy to put your datasets on storage that is connected to your GPU servers over 1Gb link. That could easily become a bottleneck. Datasets should live on Elastic Block Storage or something like that, over high speed links. Again, it's been a while since I looked into that, so I don't remember the details.
[ Parent
| on HN ]
Re:Score matching with Langevin Sampling: a new contender to...
by Reelin on Friday September 04, 2020 @02:20AM
(#24372236)
The earlier comment claimed that the GPUs (!!!) were located elsewhere on the network; I suspect that the scenario you describe is what they intended to refer to.
(IIRC AWS offers compute optimized instances with a volume that's guaranteed to be backed by blocks on a local NVMe drive.)
Re:Score matching with Langevin Sampling: a new contender to...
by nl on Friday September 04, 2020 @03:00AM
(#24372444)
I think they are confused with AWS Elastic Inference. That is a different thing which does have network attached accelerators:
Amazon Elastic inference accelerators are GPU-powered hardware devices that are designed to work with any EC2 instance, Sagemaker instance, or ECS task to accelerate deep learning inference workloads at a low cost. When you launch an EC2 instance or an ECS task with Amazon Elastic Inference, an accelerator is provisioned and attached to the instance over the network.
https://aws.amazon.com/machine-learning/elastic-inference/fa...