News for hackers. Stuff that matters.

A comment on Running large language models like ChatGPT on a single GPU. Parent comment

Re:Running large language models like ChatGPT on a single GPU by permo-w on Monday February 20, 2023 @03:55PM (#34872781)
do/did you seriously think that the processing requirement was going to “kill” that possibility?

the history of computing clearly indicates that either the requirements for running or the bar for owning this technology was always going to drop

[ Parent | on HN ]
Re:Running large language models like ChatGPT on a single GPU by pessimizer on Monday February 20, 2023 @04:08PM (#34872932)
The history of computing had Moore's Law.
[ Parent | on HN ]
Re:Running large language models like ChatGPT on a single GPU by permo-w on Monday February 20, 2023 @05:35PM (#34873862)
exactly
[ Parent | on HN ]