News for hackers. Stuff that matters.
Re:Disrupting the first reported AI-orchestrated cyber espio... by NitpickLawyer on Thursday November 13, 2025 @03:13PM (#45919923)
Meh, drama aside, I'm actually curious what would be the true capabilities of a system that doesn't go through any "safety" alignment at all. Like an all out "mil-spec" agent. Feed it everything, RL it to own boxes, and let it loose in an air-gapped network to see what the true capabilities are.

We know alignment hurts model performance (oAI people have said it, MS people have said it). We also know that companies train models on their own code (google had a blog about it recently). I'd bet good money project0 has something like this in their sights.

I don't think we're that far from a blue vs. red agents fighting and RLing off of each-other in a loop.

Re:Disrupting the first reported AI-orchestrated cyber espio... by pixl97 on Thursday November 13, 2025 @06:08PM (#45921930)
Cyberpunk has a reoccurring theme of advanced AI systems attacking and defending against each other, and for good reason.
Re:Disrupting the first reported AI-orchestrated cyber espio... by wmf on Thursday November 13, 2025 @06:58PM (#45922285)
Nous claims to be doing that but I haven't seen much discussion of it.
Re:Disrupting the first reported AI-orchestrated cyber espio... by joshellington on Thursday November 13, 2025 @08:01PM (#45922676)
I assume this is already happening. Incompetence within state actor systems being the only hurdle. The incentive and geopolitic implications is too high to NOT do it.

I just pray incompetence wins in the right way, for humanity’s sake.