News for hackers. Stuff that matters.

A comment on Are GPUs Worth It for ML?. Parent comment

Re:Are GPUs Worth It for ML? by pqn on Monday August 29, 2022 @03:02PM (#32642112)
Disclaimer: I work at Exafunction

I empathize a bit with the cloud providers as they have to upgrade their data centers every few years with new GPU instances and it's hard for them to anticipate demand.

But if you can easily use every trick in the book (CPU version of the model, autoscaling to zero, model compilation, keeping inference in your own VPC, using spot instances, etc.) then it's usually still worth it.

[ Parent | on HN ]
Re:Are GPUs Worth It for ML? by lowdose on Monday August 29, 2022 @07:02PM (#32644659)
Not to mention AWS has had a GPU cloud offering monopoly because Google Cloud and Microsoft Azure were publicly available until 2019.
[ Parent | on HN ]
Re:Are GPUs Worth It for ML? by fomine3 on Monday August 29, 2022 @10:53PM (#32646134)
GCP still provides NVIDIA K80. I wonder is it still worth to hold.
[ Parent | on HN ]
Re:Are GPUs Worth It for ML? by varunkmohan on Tuesday August 30, 2022 @12:07AM (#32646520)
I think you'd probably always want to go with T4's since they are the same price unless there's just no availability for them.
[ Parent | on HN ]