News for hackers. Stuff that matters.

A comment on ChatGPT could cost over $700k per day to operate. Parent comment

Re:ChatGPT could cost over $700k per day to operate by rapsey on Friday April 21, 2023 @10:23AM (#35654205)
Aren't Google TPUs way less performant than A100s?
[ Parent | on HN ]
Re:ChatGPT could cost over $700k per day to operate by Workaccount2 on Friday April 21, 2023 @10:46AM (#35654550)
They are actually as good or better depending on the use case. IIRC their compute is around the same, and the compute per watt is substantially better. They are also purpose built for transformers.

But google is fumbling so hard right now it's not surprising that they are squandering this too.

[ Parent | on HN ]