News for hackers. Stuff that matters.
Re:Vision Now Available in Llama.cpp by ngxson on Saturday May 10, 2025 @03:07AM (#43943777)
Ahhh no sorry I forgot that the actual code controlling this is inside llama-model.cpp ; sorry for the misinfo, the -ngl only set to max by default if you're using Metal backend

(See the code in side llama_model_default_params())

Re:Vision Now Available in Llama.cpp by danielhanchen on Saturday May 10, 2025 @03:24AM (#43943846)
Oh no worries! I re-edited my comment to account for it :)