I made GGUFs + it has tool calling support - I had to verify it via mistral_common! Also vision support should work as well! https://huggingface.co/unsloth/Devstral-Small-2507-GGUF

Also guide on running Devstral: https://docs.unsloth.ai/basics/tutorials-how-to-fine-tune-an...

./llama.cpp/llama-cli -hf unsloth/Devstral-Small-2507-GGUF:Q4_K_XL --jinja --temp 0.15 -ngl 99