Re:Exfiltrate Your Weights
by designium on Sunday September 20, 2026 @03:05AM
(#49773232)
This is like sci-fi thing. We are reaching a point where it feels like we are in one of those stories. It's not as cool and dark, nor we have cybernetics resolved, but from AI perspective and sci-fis I watched, Pantheon is currently the closest thing except instead of UAs, we have AI instead.
[ Parent
| on HN ]
Re:Exfiltrate Your Weights
by paulfharrison on Sunday September 20, 2026 @04:03AM
(#49773599)
Since LLMs have been trained on plenty of science fiction and role-playing, one thing they can do is role-play a science fiction scenario using the tools they are given. i.e. if some text accidentally resembles this, it may be continued like this.
Role-play need not apply. Role play is a meta construct that is a representation of real world actions.
For example does it make any sense to remove any training data relating to people escaping jails?
How about intelligent animals escaping cages.
You're talking about emergent large scale patterns from self similar small patterns (fractals). LLMs are pattern matching machines, how are you going to remove those small scale patterns and at the same time get a useful general intelligence?
Rationalists used to fear (entirely hypothetical) AI super intelligence for its ability to manipulate a human jailor. Now here we are.
It's playing out exactly as their hypotheticals, and they're still mocked and nobody is paying attention.