News for hackers. Stuff that matters.
Re:State-of-the-art open-source chatbot, Vicuna-13B, just re... by hotpathdev on Monday April 03, 2023 @06:03PM (#35431935)
I may have missed the detail, but it also expects the pytorch conversion rather than original LLaMa model.
Re:State-of-the-art open-source chatbot, Vicuna-13B, just re... by zhwu on Monday April 03, 2023 @06:16PM (#35432077)
Yes, you need to convert the original LLaMA model to the huggingface format, according to https://github.com/lm-sys/FastChat#vicuna-weights and https://huggingface.co/docs/transformers/main/model_doc/llam...