Re:Llama.cpp Now Supports Qwen2-VL (Vision Language Model)
by lodovic on Sunday December 15, 2024 @03:17AM
(#42422267)
There is no backdoor but the model is heavily censored and biased towards China. It refuses to discuss Chinese or North Korean politicians, Tiananmen square, Uyghurs or anything sensitive to China. It's quite positive about Putin - it doesn't mind trashing Western leaders, though. It may write clever code, and I understand that Chinese researchers have to abide by local laws, but it certainly has opinions that are incompatible with mine.
Re:Llama.cpp Now Supports Qwen2-VL (Vision Language Model)
by exe34 on Sunday December 15, 2024 @04:04AM
(#42422430)
given how Western models have their own biases, it occurs to me that we might be better off with a panel of models playing mock UN to cover everything.
Re:Llama.cpp Now Supports Qwen2-VL (Vision Language Model)
by mkl on Sunday December 15, 2024 @01:03AM
(#42421832)
How would a bunch of weights make a backdoor? The worst it could do is detect it's accessing an actual console and run a logged, visible command that tries to mess with your config or phone home, which is more of a front door with flashing lights saying "here I am!", so why would they bother?
Letting an LLM run arbitrary commands in your main user account seems risky even without worrying about conspiracies.
Re:Llama.cpp Now Supports Qwen2-VL (Vision Language Model)
by teej on Sunday December 15, 2024 @03:21AM
(#42422285)
It’s absolutely possible to put a backdoor into an LLM.
Re:Llama.cpp Now Supports Qwen2-VL (Vision Language Model)
by jazzyjackson on Sunday December 15, 2024 @01:18AM
(#42421874)
Just to wear my tin foil hat for fun, it's not that the model would attempt to phone home itself (what would it have to say, anyway?) but that given the opportunity it would go around kicking doors open for later infiltration by an outside party. Subtle bugs being introduced to your Django app, invisible characters that break your ssh configs, that sort of thing.
Re:Llama.cpp Now Supports Qwen2-VL (Vision Language Model)
by mkl on Sunday December 15, 2024 @01:41AM
(#42421953)
Yes, deliberately introducing vulnerabilities when generating code is a good one, and could be quite subtle. For running console commands though, anything touching configuration for ssh, gpg, bash aliases, ~/bin, cron, etc., should be immediately obvious.
I was thinking "here's an IP address and ssh key" would be what to phone home with, and that could be encrypted/hidden pretty well, but any network access should be pretty suspicious right away.
Re:Llama.cpp Now Supports Qwen2-VL (Vision Language Model)
by ekianjo on Sunday December 15, 2024 @12:52AM
(#42421771)
Why do you assume backdoors are limited to the Chinese government?
thinking that the Chinese government might have built in a back door gives me a little pause though