News for hackers. Stuff that matters.

A comment on ChatGPT Hardware a Look at 8x Nvidia A100 Powering the Tool. Parent comment

Re:ChatGPT Hardware a Look at 8x Nvidia A100 Powering the Tool by TOMDM on Tuesday February 14, 2023 @01:11PM (#34793436)
A bit of extra context, that's $8.8/hr for the 40GB A100's

The 80GB A100's will run you $12.0/hr for 8 of them.

[ Parent | on HN ]
Re:ChatGPT Hardware a Look at 8x Nvidia A100 Powering the Tool by fancyfredbot on Tuesday February 14, 2023 @02:36PM (#34794751)
That's 24k over 3 months which would buy and power 8 4090 GPUs by my reckoning. Of course those 8 4090s wouldn't have enough memory to run chatGPT so maybe AWS is good value after all.
[ Parent | on HN ]
Re:ChatGPT Hardware a Look at 8x Nvidia A100 Powering the Tool by TOMDM on Tuesday February 14, 2023 @03:02PM (#34795120)
This is Lambda Labs' pricing, which is significantly cheaper than AWS.
[ Parent | on HN ]