News for hackers. Stuff that matters.
Re:Revealing the details of how OpenAI agents hacked Hugging... by aesthesia on Friday September 25, 2026 @11:57PM (#49853066)
The inference is more like "people place sufficient amounts of infrastructure under direct control of a sufficiently capable AI" -> "there is no way to ensure that humans will actually be able to shut down the AI". My claim is not that this inevitably means that the AI will resist shutdown, or that it will inevitably take harmful actions, just that there is a nonnegligible chance that it could. The downside is large enough that even a relatively small chance is something to be worried about.
Re:Revealing the details of how OpenAI agents hacked Hugging... by jquery on Saturday September 26, 2026 @11:44AM (#49857612)
You can’t just say “well, the downside is big, I don’t have to provide good evidence for my side of the argument.” Because I can just as easily say, “the upside is big, …”. And the upside is big, after all, AI can do all the shitty jobs for us and humanity achieves the utopia it’s been chasing for eons.
Re:Revealing the details of how OpenAI agents hacked Hugging... by aesthesia on Saturday September 26, 2026 @02:40PM (#49859283)
I think it's a good idea, when considering changes of this magnitude, to make an affirmative safety case for them rather than just saying "eh, I can't think of any way this could possibly go wrong."
Re:Revealing the details of how OpenAI agents hacked Hugging... by jquery on Sunday September 27, 2026 @12:23AM (#49863335)
It’s millions of people making small changes that sum up to a large change, aka freedom. And if you want to take away people’s freedom, I think you need a concrete reason. And you need to make an affirmative safety case for the massive government powers needed to regulate millions of people’s ability to compute.