News for hackers. Stuff that matters.
Re:Vision Now Available in Llama.cpp by danielhanchen on Saturday May 10, 2025 @02:54AM (#43943715)
:)) I did have to update the chat template for Mistral - I did see your PR in llama.cpp for it - confusingly the tokenizer_config.json file doesn't have a chat_template, and it's rather in chat_template.jinja - I had to move the chat template into tokenizer_config.json, but I guess now with your fix its fine :)
Re:Vision Now Available in Llama.cpp by ngxson on Saturday May 10, 2025 @03:01AM (#43943745)
Ohhh nice to know! I was pretty sure that someone already tried to fix the chat template haha, but because we also allow users to freely create their quants via the GGUF-my-repo space, I have to fix the quants produces from that source
Re:Vision Now Available in Llama.cpp by danielhanchen on Saturday May 10, 2025 @03:23AM (#43943845)
Glad it all works now!