Re:Mistral AI Launches New 8x22B MOE Model
by LeoPanthera on Wednesday April 10, 2024 @03:34PM
(#39994869)
Make sure you get the prompt template set correctly, the defaults are wrong for a lot of models.
[ Parent
| on HN ]
Re:Mistral AI Launches New 8x22B MOE Model
by unifer1 on Wednesday April 10, 2024 @07:50PM
(#39996907)
Could you explain how to do this properly ? I've been having problems with the app and am wondering if this is ehy
Re:Mistral AI Launches New 8x22B MOE Model
by LeoPanthera on Wednesday April 10, 2024 @08:23PM
(#39997158)
Look at the HuggingFace page for the model you are using. (The original page, not the page for the GGUF conversion, if necessary.) This will explain the chat format you need to use.