Llama.cpp guide – Running LLMs locally on any hardware, from scratch

Re:Llama.cpp guide – Running LLMs locally on any hardware, f... by stuckkeys on Friday November 29, 2024 @02:01PM (#42276137)

I never understand these guardrails. The whole point of llms (imo) is for quick access to knowledge. If I want to better understand reverse shell or kernel hooking, why not tell me? But instead, “sorry, I ain’t telling you because you will do harm” lol

[ Parent | on HN ]

Re:Llama.cpp guide – Running LLMs locally on any hardware, f... by TeMPOraL on Friday November 29, 2024 @02:37PM (#42276431)

Key insight: the guardrails aren't there to protect you from harmful knowledge; they're there to protect the company from all those wackos on the Internet who love to feign offense at anything that can get them a retweet, and journalists who amplify their outrage into storms big enough to depress company stock - or, in worst cases, attract attention of politicians.

[ Parent | on HN ]

Re:Llama.cpp guide – Running LLMs locally on any hardware, f... by mistermann on Friday November 29, 2024 @03:02PM (#42276652)

There are also plausibly some guardrails resulting from oversight by three letter agencies.

I don't take everything Marc Andreessen said in his recent interview with Joe Rogan at face value, but I don't dismiss any of it either.

[ Parent | on HN ]