Llama.cpp guide – Running LLMs locally on any hardware, from scratch

Re:Llama.cpp guide – Running LLMs locally on any hardware, f... by yjftsjthsd-h on Saturday November 30, 2024 @12:13AM (#42279670)

Are they specifically flagging LLMs, or do they not like Cosmopolitan Libc / APE?

[ Parent | on HN ]

Re:Llama.cpp guide – Running LLMs locally on any hardware, f... by chatmasta on Saturday November 30, 2024 @12:59AM (#42279875)

Nah nothing to do with LLMs, it’s just because the method of Llamafile is very similar to malware - basically zip up an executable, concatenate it with some stuff, throw it in /tmp and execute it with a randomly generated high entropy name.

(That said, after I explained it to SecOps they did tell me I would need to “consult legal” if I wanted to use a local LLM, but I’ll give them the benefit of the doubt there…)

[ Parent | on HN ]