News for hackers. Stuff that matters.

A comment on Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generations based on LLaMa. Parent comment

Re:Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generat... by kolinko on Wednesday March 29, 2023 @09:50AM (#35357266)
Any tips on setting up llama+lora on 30b? There are so many resources that I can't figure out which models to use, and which projects to use to set everything up.
[ Parent | on HN ]
Re:Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generat... by nickthegreek on Wednesday March 29, 2023 @11:10AM (#35358387)
text-generation-webui (https://github.com/oobabooga/text-generation-webui)
[ Parent | on HN ]
Re:Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generat... by kolinko on Thursday March 30, 2023 @04:32AM (#35369700)
I tried it, but I can't find the right model for llama+lora 30B . Google, nor Bing ;) is not helpful.
[ Parent | on HN ]
Re:Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generat... by nickthegreek on Thursday March 30, 2023 @09:34AM (#35372462)
I think this is the one you want: https://huggingface.co/elinas/alpaca-30b-lora-int4
[ Parent | on HN ]