How long if you build it your own incl electricity prices? If margins are similar to other EC2 instances, you'd probably break-even after 6 months or so. Which makes EC2 uneconomical for any lab/company that can utilise the cluster 24/7.
Still nice if you quickly need to get some model results though.
Amazon prices are for the pay as you go model. You can shave a significant amount off the price if you know you're going to be running them for 12 months.
Re:Introducing Amazon EC2 P3 Instances
by dexterdog on Thursday October 26, 2017 @12:55PM
(#15560708)
And even less if it's 36 months.
If you're going to be running it for 24x7 for 3 years, I think it'd be worth doing the apples-to-apples comparison of buying your own V100s vs renting them from AWS. The DGX Station with 4 V100s is $70k
You’d still build your own for that money, I think, but it’s an interesting datapoint.