News for hackers. Stuff that matters.

A comment on Ask HN: How can ChatGPT serve 700M users when I can't run one GPT-4 locally?. Parent comment

Re:Ask HN: How can ChatGPT serve 700M users when I can't run... by robotnikman on Friday August 08, 2025 @05:58PM (#44842101)
I wonder then if its possible to load the unused parts into main memory, while the more used parts into VRAM
[ Parent | on HN ]

There are no comments on this comment yet.