News for hackers. Stuff that matters.

A comment on Running large language models like ChatGPT on a single GPU. Parent comment

Re:Running large language models like ChatGPT on a single GPU by permo-w on Monday February 20, 2023 @02:43PM (#34871986)
yeah there an absolute pile of LLMs that are fully open-source. OpenAI’s GPT2 for one, but also Bloom, OPT, GPT-J, and I’m sure myriad others too
[ Parent | on HN ]
Re:Running large language models like ChatGPT on a single GPU by Miraste on Monday February 20, 2023 @08:51PM (#34875489)
Nothing in the ballpark of GPT-3.5 or Prometheus yet, but we'll get there.
[ Parent | on HN ]