News for hackers. Stuff that matters.
Re:Qwen3-VL by te0006 on Wednesday September 24, 2025 @05:40AM (#45358093)
Interesting - do you need to take any special measures to get OSS genAI models to work on this architecture? Can you use inference engines like Ollama and vLLM off-the-shelf (as Docker containers) there, with just the Radeon 8060S GPU? What token rates do you achieve?

(edit: corrected mistake w.r.t. the system's GPU)

Re:Qwen3-VL by buyucu on Wednesday September 24, 2025 @07:24AM (#45358845)
I just use llama.cpp. It worked out of the box.