News for hackers. Stuff that matters.
Re:We Must Pace the Frontier by 8note on Saturday September 12, 2026 @04:20PM (#49676774)
alignment isnt particularly required

we are passing in training data that says to do those felonies. we dont have to. we could also have the thing predict whether what its about to do is illegal or not before doing it.

theyre choosing to build felony harnesses. the model just outputs tokens, not felonies

Re:We Must Pace the Frontier by cowanon77 on Saturday September 12, 2026 @04:29PM (#49676861)
> we are passing in training data that says to do those felonies.

Partially, but also I don't think current AIs really have any judgement of right and wrong, they just see chains of reasoning between ideas. This is the deeper issue, there is no way to sanitize the data or training to fix it. Current AIs are fundamentally unsafe, and only become more unsafe as they become more powerful.

Re:We Must Pace the Frontier by estearum on Saturday September 12, 2026 @04:29PM (#49676857)
Assuming "adherence to arbitrary, implicit, and context-dependent rulesets" is the default behavior of uhhhh... anything at all... is a truly ridiculous assumption.