Re:Gemma 3 270M: The compact model for hyper-efficient AI
by rao-v on Thursday August 14, 2025 @10:11PM
(#44907884)
Fabulous stuff!
Oh my request … the vision head on the Gemma models is super slow on CPU inferencing (and via Vulcan), even via llama.cpp. Any chance your team can figure out a solve? Other ViTs don’t have the same problem.
Oh my request … the vision head on the Gemma models is super slow on CPU inferencing (and via Vulcan), even via llama.cpp. Any chance your team can figure out a solve? Other ViTs don’t have the same problem.