News for hackers. Stuff that matters.

A comment on Running large language models like ChatGPT on a single GPU. Parent comment

Re:Running large language models like ChatGPT on a single GPU by Filligree on Monday February 20, 2023 @03:21PM (#34872410)
Running it off a fast NVMe apparently works. I don't know what the performance is like, though.
[ Parent | on HN ]

There are no comments on this comment yet.