The genie escapes: Stanford copies the ChatGPT AI for less than $600

Re:The genie escapes: Stanford copies the ChatGPT AI for les... by satvikpendem on Monday March 20, 2023 @06:58PM (#35240051)

You might need to fix your parameters. From the text-generation-gui guide:

> For a more creative chat, use: temp 0.72, rep pen 1.1, top_k 0, and top_p 0.73

> For a more precise chat, use temp 0.7, repetition_penalty 1.1764705882352942 (1/0.85), top_k 40, and top_p 0.1

https://old.reddit.com/r/LocalLLaMA/comments/11o6o3f/how_to_...

https://old.reddit.com/r/singularity/comments/11vsvro/in_cas...

https://twitter.com/theshawwn/status/1632569215348531201

---

That being said, I found the OpenAssistant model much better: https://huggingface.co/spaces/olivierdehaene/chat-llm-stream...

It's also completely OSS, Apache 2.0, unlike LLaMA and Alpaca which are non-commercial.

[ Parent | on HN ]

Re:The genie escapes: Stanford copies the ChatGPT AI for les... by circuit10 on Monday March 20, 2023 @07:29PM (#35240370)

I’m impressed by how ChatGPT-like it is but also it’s saying things like

“No, OpenAI does not have an API for dogs. They do, however, have an API for other animals, such as cats. To retrieve an image of a cat, you can use the OpenAI API for Dogs API and select the cat breed or type.”

[ Parent | on HN ]

Re:The genie escapes: Stanford copies the ChatGPT AI for les... by superkuh on Monday March 20, 2023 @10:59PM (#35242048)

I've tried all sorts of parameters including those exact ones. As for the huggingface stuff, it's not exactly clear how to use it without going down the python dependency rabbit hole. I am not confident I could get the correct python packages all together on Debian 11 to support running it. The llama.cpp stuff is very simple to compile and run comparatively.

[ Parent | on HN ]