Re:State-of-the-art open-source chatbot, Vicuna-13B, just re...
by hotpathdev on Monday April 03, 2023 @06:03PM
(#35431935)
I may have missed the detail, but it also expects the pytorch conversion rather than original LLaMa model.
[ Parent
| on HN ]
Re:State-of-the-art open-source chatbot, Vicuna-13B, just re...
by zhwu on Monday April 03, 2023 @06:16PM
(#35432077)
Yes, you need to convert the original LLaMA model to the huggingface format, according to https://github.com/lm-sys/FastChat#vicuna-weights and https://huggingface.co/docs/transformers/main/model_doc/llam...