Olmo 3: Charting a path through the model flow to lead open-source AI

Re:Olmo 3: Charting a path through the model flow to lead op... by solarkraft on Friday November 21, 2025 @06:40AM (#46003560)

Looks like it: https://ollama.com/library/qwen3-vl:30b-a3b

[ Parent | on HN ]

Re:Olmo 3: Charting a path through the model flow to lead op... by thot_experiment on Friday November 21, 2025 @04:03PM (#46008969)

fwiw on my machine it is 1.5x faster to inference in llama.cpp, these the settings i use for inference for the qwen i just keep in vram permanently

    llama-server --host 0.0.0.0 --model Qwen3-VL-30B-A3B-Instruct-UD-Q4_K_XL.gguf --mmproj qwen3-VL-mmproj-F16.gguf --port 8080 --jinja --temp 0.7 --top-k 20 --top-p 0.8 -ngl 99 -c 65536 --repeat_penalty 1.0 --presence_penalty 1.5

[ Parent | on HN ]