News for hackers. Stuff that matters.
Re:Vision Now Available in Llama.cpp by danielhanchen on Saturday May 10, 2025 @02:43AM (#43943667)
I'm also extremely pleased with convert_hf_to_gguf.py --mmproj - it makes quant making much simpler for any vision model!

Llama-server allowing vision support is definitely super cool - was waiting for it for a while!

There are no comments on this comment yet.