News for hackers. Stuff that matters.

A comment on Running large language models like ChatGPT on a single GPU. Parent comment

Re:Running large language models like ChatGPT on a single GPU by Miraste on Monday February 20, 2023 @08:49PM (#34875481)
OPT-175B isn't publicly available, sadly. It's available to research institutions, which is much better than "Open"AI, but it doesn't help us hobbyists/indie researchers much.
[ Parent | on HN ]
Re:Running large language models like ChatGPT on a single GPU by generalizations on Tuesday February 21, 2023 @08:50AM (#34881093)
I wonder when we'll start putting these models on the pirate bay or similar. Seems like an excellent use for the tech. Has no one tried to upload OPT-175B anywhere like that yet?
[ Parent | on HN ]
Re:Running large language models like ChatGPT on a single GPU by cma on Tuesday February 21, 2023 @01:23PM (#34884737)
It could go on the clear net since trained weights aren't subject to copyright.
[ Parent | on HN ]