News for hackers. Stuff that matters.

A comment on OpenAI illegally barred staff from airing safety risks, whistleblowers say. Parent comment

Re:OpenAI illegally barred staff from airing safety risks, w... by dr_kiszonka on Tuesday July 16, 2024 @09:40AM (#40976533)
Your comment made me think that as long as weights/network are frozen, AI cannot improve itself. Monitoring them would be critical for safety. Is this correct?
[ Parent | on HN ]
Re:OpenAI illegally barred staff from airing safety risks, w... by TeMPOraL on Tuesday July 16, 2024 @10:00AM (#40976700)
The distinction between code and data is just an illusion. If the "code" is frozen but IO unconstrained, then it's just as if the "code" wasn't frozen.
[ Parent | on HN ]
Re:OpenAI illegally barred staff from airing safety risks, w... by lijok on Tuesday July 16, 2024 @10:11AM (#40976809)
The problem is unfortunately a human one. As soon as someone figures out the 11 herbs and spices to unlock AGI, no matter how good their safety systems are, someone else will run off and build their own, without the safety systems in place.
[ Parent | on HN ]