News for hackers. Stuff that matters.

A comment on Running large language models like ChatGPT on a single GPU. Parent comment

Re:Running large language models like ChatGPT on a single GPU by rjb7731 on Monday February 20, 2023 @03:41PM (#34872637)
Looks like its no bueno on google colab, also it takes prompts in via input() too rather then a command line argument.
[ Parent | on HN ]
Re:Running large language models like ChatGPT on a single GPU by hackernewds on Tuesday February 21, 2023 @12:40PM (#34884090)
Could it work on Google Colab?
[ Parent | on HN ]