Re:Mistral AI Launches New 8x22B MOE Model
by fzzzy on Wednesday April 10, 2024 @07:55PM
(#39996933)
There was a buffer overflow or some other exploit like that in llama.cpp and the gguf format. It has been fixed now, but it's definitely possible. Also weights distributed as python pickles can run arbitrary code.
[ Parent
| on HN ]
Re:Mistral AI Launches New 8x22B MOE Model
by bevekspldnw on Wednesday April 10, 2024 @10:33PM
(#39997852)
Distributing anything as python pickles seems utterly batshit to me.