I made GGUFs + it has tool calling support - I had to verify it via mistral_common! Also vision support should work as well! https://huggingface.co/unsloth/Devstral-Small-2507-GGUF

Also guide on running Devstral: https://docs.unsloth.ai/basics/tutorials-how-to-fine-tune-an...

./llama.cpp/llama-cli -hf unsloth/Devstral-Small-2507-GGUF:Q4_K_XL --jinja --temp 0.15 -ngl 99

This is a great new AI 'Mistral Medium' model from Mistral, I used it in Zed editor today via Mistral API – and will keep on using this. It brings great code suggestions, improvements and explanations. Worth to give it a go.

Note: should be configured manually in Zed at time of this writing but then works like charm. (Use devstral-medium-2507 or devstral-medium-latest)