News for hackers. Stuff that matters.

A comment on Introducing ChatGPT and Whisper APIs. Parent comment

Re:Introducing ChatGPT and Whisper APIs by lumost on Wednesday March 01, 2023 @02:28PM (#34987077)
Isn’t it 2.25 per hour per a100?
[ Parent | on HN ]
Re:Introducing ChatGPT and Whisper APIs by TheMagicHorsey on Wednesday March 01, 2023 @02:33PM (#34987143)
Yes, he means 2.25 per hour with a 1 yr reservation.
[ Parent | on HN ]
Re:Introducing ChatGPT and Whisper APIs by p1esk on Thursday March 02, 2023 @01:28AM (#34992690)
You can get A100 on Lambda Labs cloud for $1.1/hr ($8.8/hr per 8xA100) without any reservation.
[ Parent | on HN ]
Re:Introducing ChatGPT and Whisper APIs by gyrovagueGeist on Wednesday March 01, 2023 @03:13PM (#34987652)
Its a good baseline, but I very much doubt that openAI is paying anywhere near the public cost for their compute allocation.
[ Parent | on HN ]
Re:Introducing ChatGPT and Whisper APIs by lumost on Wednesday March 01, 2023 @04:39PM (#34988710)
Direct purchasing isn’t too much cheaper. An H100 costs 35k new. OpenAI and MS are probably getting those for around 16k about 1.82 per hour.
[ Parent | on HN ]