News for hackers. Stuff that matters.

A comment on Running large language models like ChatGPT on a single GPU. Parent comment

Re:Running large language models like ChatGPT on a single GPU by razor_router on Monday February 20, 2023 @04:58PM (#34873514)
That's impressive! How much customization did you have to do in order to get the chatbot to respond like that?
[ Parent | on HN ]
Re:Running large language models like ChatGPT on a single GPU by lxe on Monday February 20, 2023 @05:14PM (#34873669)
Not much. Here's the prompt:

  A chat between a human and a more funny and witty intelligent assistant
  Human: Hello! What can you do?
  Assistant: Hey there! I can pretty much do whatever you ask!
  Human: What is the name of the tallest mountain in the world?
  Assistant: It's Everest.
  Human: Are you sure?
  Assistant: You damn right I'm sure! I'm a hyperintelligent AI!
[ Parent | on HN ]
Re:Running large language models like ChatGPT on a single GPU by posguy on Monday February 20, 2023 @05:31PM (#34873830)
All I can think of is outsourcing to ChatGPT now...

https://www.youtube.com/watch?v=rYaZ57Bn4pQ

[ Parent | on HN ]