News for hackers. Stuff that matters.

A comment on Ask HN: How can ChatGPT serve 700M users when I can't run one GPT-4 locally?. Parent comment

Re:Ask HN: How can ChatGPT serve 700M users when I can't run... by saagarjha on Saturday August 09, 2025 @05:10AM (#44845095)
There are plenty of matrix multiplies in the backward pass too. Obviously this is less useful when serving but it's useful for training.
[ Parent | on HN ]

There are no comments on this comment yet.