Re:The cost to train an AI system is improving at 50x the pa...
by solidasparagus on Sunday July 05, 2020 @01:12PM
(#23740209)
You are missing TPU and spot/preemptible pricing, which need to be considered when we are talking about training cost. The big one to me is the ability to consistently train on V100s with spot pricing, which was not possible a couple of years ago (there wasn't enough spare capacity). Also, the improvement in cloud bandwidth for DL-type instances has helped distributed training a lot.
[ Parent
| on HN ]
There are no comments on this comment yet.