News for hackers. Stuff that matters.
Re:V100 Server On-Prem vs. AWS P3 Instance Cost Comparison by mippie_moe on Tuesday February 19, 2019 @01:05AM (#19196969)
Hi, Lambda engineer here (I'm one of the authors). You bring up some good points, I'd like to address some of them:

Admin:

Time (and cost) it takes to install software, drivers, etc

These tasks aren't made unnecessary by cloud. Yes, with cloud, once you've done the work, it can be forever encoded into an image or container. However, the same applies to on-prem using container solutions like Docker.

Maintenance / Capitalization / Finances:

3-year? What is the useful life of this? When does it seemingly become obsolete?

With GPUs of recent history, obsolescence is not a concern in a 3-year time frame. On AWS, people are still using K80s (released in 2014!). The GTX 1080 Ti, which was released 2.5 years ago, is selling for substantially above MSRP. This may change if competition in the GPU space increases and NVIDIA loses its monopoly.

AWS will continually upgrade their hardware and you keep paying the same

True, but this concern is mitigated by slow rate of GPU obsolescence.

Hardware can be capitalized, which means you can push it to the balance sheet (for tax or valuation purposes)

Can you say a little more about this? Not sure what you're getting at.

Spending $90k instead of $184k in year 1 with the option to turn it off if you want (no longer need). This could be very valuable for a startup who wants elastic spending patterns.

This needs to be evaluated on a case-by-case basis. A poorly-capitalized start-up with an unpredictable compute workload is not a good candidate for buying on-prem. A well-capitalized start-up that consistently uses GPUs is a better candidate.

Returns, breakage, warranty in case of a hardware failure

Any reasonable hardware provider will include an option for 3-year warranty.

Re:V100 Server On-Prem vs. AWS P3 Instance Cost Comparison by alvar0 on Tuesday February 19, 2019 @05:36AM (#19198004)
>Hardware can be capitalized, which means you can push it to the balance sheet (for tax or valuation purposes) Can you say a little more about this? Not sure what you're getting at.

I think he means this: that hardware goes to your balance sheet, then it depreciates by a certain amount over those 3 years and that loss may be tax-deductible.

Re:V100 Server On-Prem vs. AWS P3 Instance Cost Comparison by wongarsu on Tuesday February 19, 2019 @08:52AM (#19198906)
In other words: on your bank account it looks like an upfront cost, but because you could sell the servers at any time they really look more like a rental in your books, with capital slowly draining away each year as they become worth less.
Re:V100 Server On-Prem vs. AWS P3 Instance Cost Comparison by mbesto on Tuesday February 19, 2019 @10:56AM (#19199788)
Correct. Depending on what accounting principals you use, this is typically 3-5 years. It's akin to an airlines buying a Boeing plane. It'll cost them $1B let's say, but it'll actually hit their income over 35 years ($1b / 35), which means on their income statement, only ~$28M shows up per year (simplified example). Most companies are valued and taxed on their income, so this is important to understand.
Re:V100 Server On-Prem vs. AWS P3 Instance Cost Comparison by colde on Tuesday February 19, 2019 @04:42AM (#19197805)
> Any reasonable hardware provider will include an option for 3-year warranty.

Did you include the cost for that in your scenario?

Re:V100 Server On-Prem vs. AWS P3 Instance Cost Comparison by nightfly on Tuesday February 19, 2019 @04:51AM (#19197838)
For a reasonable vendor, a 3 year warranty is have a negligible cost. (~5-10% of the price of the system)
Re:V100 Server On-Prem vs. AWS P3 Instance Cost Comparison by ocdtrekkie on Tuesday February 19, 2019 @08:14AM (#19198696)
In fact, for most enterprise grade hardware I've ever purchased, the three year warranty tends to be pretty much built into the cost. Usually where I pay extra is to add the fourth and fifth years.