Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generations based on LLaMa

Re:Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generat... by nathanasmith on Tuesday March 28, 2023 @11:19PM (#35351896)

There is ChatGLM[0], a 6 billion parameter Chinese/English bilingual model that is gaining a reputation as the leading locally runnable LLM for code generation. Maybe look into that. Demo is here[1].

[0]https://github.com/THUDM/ChatGLM-6B/blob/main/README_en.md [1]https://huggingface.co/spaces/multimodalart/ChatGLM-6B

[ Parent | on HN ]

Re:Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generat... by nmfisher on Tuesday March 28, 2023 @11:26PM (#35351974)

I tried this the other day for generating basic Chinese conversations - the quality is surprisingly good. While it's still behind the latest GPT, but the gap isn't as large as I thought it would be.

[ Parent | on HN ]

Re:Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generat... by alchemist1e9 on Wednesday March 29, 2023 @02:54PM (#35361582)

This does seem promising when playing with the demo. That says running on a T4 I believe. This probably means we are only months away from viable self hosted code generation and analysis that could compete with gpt 3.5 turbo.

It seems like working on locally runnable LLM that has been fine tuned to focus on code should be a high priority.

[ Parent | on HN ]