News for hackers. Stuff that matters.

A comment on Ask HN: How can ChatGPT serve 700M users when I can't run one GPT-4 locally?. Parent comment

Re:Ask HN: How can ChatGPT serve 700M users when I can't run... by stogot on Friday August 08, 2025 @06:59PM (#44842557)
Hasn’t the Inferentia chip been around long enough to make the same argument? AWS and Google probably have the same order of magnitude of their own custom chips
[ Parent | on HN ]
Re:Ask HN: How can ChatGPT serve 700M users when I can't run... by saagarjha on Saturday August 09, 2025 @05:13AM (#44845111)
Inferentia has a generally worse stack but yes
[ Parent | on HN ]