News for hackers. Stuff that matters.

A comment on ChatGPT Hardware a Look at 8x Nvidia A100 Powering the Tool. Parent comment

Re:ChatGPT Hardware a Look at 8x Nvidia A100 Powering the Tool by p1esk on Tuesday February 14, 2023 @12:36PM (#34792887)
Andrej Karpathy talked about how our DeepLearning11 build (8x 1080 Ti's) had a ~3 month payback period versus AWS

In 2017. Currently you can rent 8xA100 server for $8.8/hr: https://lambdalabs.com/service/gpu-cloud

At this price the payback stretches to about 3 years (taking into account average energy costs in US, and assuming 24/7 operation for the whole 3 years).

[ Parent | on HN ]
Re:ChatGPT Hardware a Look at 8x Nvidia A100 Powering the Tool by TOMDM on Tuesday February 14, 2023 @01:11PM (#34793436)
A bit of extra context, that's $8.8/hr for the 40GB A100's

The 80GB A100's will run you $12.0/hr for 8 of them.

[ Parent | on HN ]
Re:ChatGPT Hardware a Look at 8x Nvidia A100 Powering the Tool by fancyfredbot on Tuesday February 14, 2023 @02:36PM (#34794751)
That's 24k over 3 months which would buy and power 8 4090 GPUs by my reckoning. Of course those 8 4090s wouldn't have enough memory to run chatGPT so maybe AWS is good value after all.
[ Parent | on HN ]
Re:ChatGPT Hardware a Look at 8x Nvidia A100 Powering the Tool by TOMDM on Tuesday February 14, 2023 @03:02PM (#34795120)
This is Lambda Labs' pricing, which is significantly cheaper than AWS.
[ Parent | on HN ]