News for hackers. Stuff that matters.

A comment on Running large language models like ChatGPT on a single GPU. Parent comment

Re:Running large language models like ChatGPT on a single GPU by mensetmanusman on Monday February 20, 2023 @03:50PM (#34872734)
It’s fun to think about a few billion weights being the difference between useless and gold.
[ Parent | on HN ]
Re:Running large language models like ChatGPT on a single GPU by tiborsaas on Monday February 20, 2023 @04:17PM (#34873042)
Looking at my bank account I can relate :)
[ Parent | on HN ]