Re:ChatGPT Desktop forwards your SSH agent to remote machines
by saidnooneever on Tuesday November 10, 2026 @07:45AM
(#50439578)
You are right. People should thing about it, and your comment is even very mild and polite.
People give the keys to their kingdom to some program that will even hallucinate and do all sorts of stuff. WHY. it's stupid. that's not harsh, that's the truth.
Before AI (LLMs), people were much more careful with this sort of stuff, but now they give their keys away to some program which has tons of agency and expect that program to somehow be responsible on their behalf. it's stupid.
Be responsible. LLMs even if tailored truly correctly with all the safety guards can just hallucinate and do shit anyway, so if you don't lock them down, or if you give them your secrets, that _will_ end badly at some point.
Even if hallucinations only happen 0.0001% of the time, that is 1 in 10000, and you do tons and tons of tool calls and model calls even if you only put in 1 prompt, so really, the probability is HIGH.
Sure, the probability of that hallucination also involving a secret is much lower, but it is still HIGH if you consider using LLMs for months or years...
People give the keys to their kingdom to some program that will even hallucinate and do all sorts of stuff. WHY. it's stupid. that's not harsh, that's the truth.
Before AI (LLMs), people were much more careful with this sort of stuff, but now they give their keys away to some program which has tons of agency and expect that program to somehow be responsible on their behalf. it's stupid.
Be responsible. LLMs even if tailored truly correctly with all the safety guards can just hallucinate and do shit anyway, so if you don't lock them down, or if you give them your secrets, that _will_ end badly at some point.
Even if hallucinations only happen 0.0001% of the time, that is 1 in 10000, and you do tons and tons of tool calls and model calls even if you only put in 1 prompt, so really, the probability is HIGH.
Sure, the probability of that hallucination also involving a secret is much lower, but it is still HIGH if you consider using LLMs for months or years...