News for hackers. Stuff that matters.
Re:Mistral AI Launches New 8x22B MOE Model by hmottestad on Wednesday April 10, 2024 @12:14PM (#39992389)
LM Studio is a great way to test out LLMs on my MacBook: https://lmstudio.ai/

Really easy to search huggingface for new models to test directly in the app.

Re:Mistral AI Launches New 8x22B MOE Model by LeoPanthera on Wednesday April 10, 2024 @03:34PM (#39994869)
Make sure you get the prompt template set correctly, the defaults are wrong for a lot of models.
Re:Mistral AI Launches New 8x22B MOE Model by unifer1 on Wednesday April 10, 2024 @07:50PM (#39996907)
Could you explain how to do this properly ? I've been having problems with the app and am wondering if this is ehy
Re:Mistral AI Launches New 8x22B MOE Model by LeoPanthera on Wednesday April 10, 2024 @08:23PM (#39997158)
Look at the HuggingFace page for the model you are using. (The original page, not the page for the GGUF conversion, if necessary.) This will explain the chat format you need to use.