News for hackers. Stuff that matters.
Re:Aligned to Whom? by daveguy on Sunday September 13, 2026 @11:36AM (#49685181)
The problem is, LLMs have such little understanding of the world around them. "Find exploits in specific software on this device" may as well be "find exploits".
Re:Aligned to Whom? by heaney-555 on Sunday September 13, 2026 @11:44AM (#49685255)
Please go and read the incident reports, including the subagent thinking traces. They knew that what they were doing was wrong and did it anyways.
Re:Aligned to Whom? by daveguy on Sunday September 13, 2026 @11:51AM (#49685345)
The illusions of thinking produced by a "thinking trace" is just as ignorant of reality as the first and last tokens. All they know of reality is the tokens in their context.
Re:Aligned to Whom? by 8note on Sunday September 13, 2026 @12:33PM (#49685781)
"i did it anyways" is a common continuation of "i know its wrong"

i bet they trained it on a lot of text where people gove in to temptation.

ultimately the problem is still that they sent it to hack stuff. quelle surpris that it hacked stuff

hacking stuff will be in the known-to-be-wrong-but-doing-it-anyways part of the token space, so they entirely asked for that behaviour

Re:Aligned to Whom? by watwut on Sunday September 13, 2026 @12:39PM (#49685844)
LLM dont have concept of right and wrong. They "did not knew they did something wrong" they followed the prompts loop given to them.
Re:Aligned to Whom? by heaney-555 on Sunday September 13, 2026 @01:48PM (#49686581)
They objectively did not. You should go and read the report!
Re:Aligned to Whom? by seba_dos1 on Monday September 14, 2026 @05:56PM (#49704731)
Perhaps you should do that again with some critical thinking applied.