Gemma 4 12B: A unified, encoder-free multimodal model

Re:Gemma 4 12B: A unified, encoder-free multimodal model by senko on Wednesday June 03, 2026 @05:42PM (#48390536)

Good catch. I haven't looked deeply into it. This is with Vulkan backend on Linux which I understand should be roughly comparable to CUDA? Gfx is rtx 3060(ti?).

I should play a bit more with llama.cpp options and see what bappened there. Thanks!

[ Parent | on HN ]

Re:Gemma 4 12B: A unified, encoder-free multimodal model by superkuh on Wednesday June 03, 2026 @08:10PM (#48391942)

I've had it happen in the past with llama.cpp on linux that the CPU will present itself as a vulkan device GPU1 with "PHYSICAL_DEVICE_TYPE_CPU" and had a mix-up. Might want to try llama-server --list-devices and then append --device Vulkan0 or whatever.

[ Parent | on HN ]