News for hackers. Stuff that matters.

A comment on Introducing ChatGPT and Whisper APIs. Parent comment

Re:Introducing ChatGPT and Whisper APIs by vishal0123 on Wednesday March 01, 2023 @08:04PM (#34990613)
> will set you back $100k/yr

This is 6 month of salary of one average developer's salary there. And BTW they are likely doing inference on 100s or 1000s of GPUs, not just 8.

[ Parent | on HN ]
Re:Introducing ChatGPT and Whisper APIs by kkielhofner on Thursday March 02, 2023 @06:58PM (#35003822)
Yes and a devops engineer to manage an even moderately complex cloud deployment is an average of an extra $150k/yr. I don't know where this "cloud labor skill, knowledge, experience, and time is free" thinking comes from.

8, 80k, or 800k GPUs depending on requirements and load - the point remains the same.

[ Parent | on HN ]