The answer is not to reduce our understanding. That is the worst possible conclusion we could draw from what we're seeing. The answer is to increase it.
Re:Sshole
by stillpointlab on Friday November 06, 2026 @11:32AM
(#50394585)
That is similar to saying to Magnus Carlson that he should just increase his understanding of chess.
The point of my comment is, no amount of "increased understanding" puts a human on equal footing to a chess engine.
Re:Sshole
by ShinyLeftPad on Thursday November 05, 2026 @07:56PM
(#50386808)
> non-intuitive alien code being generated by agents
You're saying it as if humans can't write that too.
Re:Sshole
by stillpointlab on Friday November 06, 2026 @11:34AM
(#50394617)
I am saying that we won't be able to write it, in the same way that Magnus Carlson (or whoever your top chess player would be) cannot compete with a chess engine.
I am arguing that, much like the "best" chess move is unintelligible to best chess players, truly secure code will be unintelligible to humans.
Re:Sshole
by ShinyLeftPad on Friday November 06, 2026 @11:48AM
(#50394823)
To make good code intelligible is compiler's job
This might be the beginning of the reason we shouldn't be reading the code. It's like in chess engines where the players complain about how weird, alien and unintuitive the moves are. But 100 steps down the line the engine finds some edge case exploit that gives it enough advantage to win.
So we may be crossing a line, right now, where the non-intuitive alien code being generated by agents is seeing edge cases down the line that might allow exploits. And if we "correct" the agent, we may be leaving ourselves open to exploits we don't see and have difficulty understanding.