News for hackers. Stuff that matters.
Re:SafeLife: AI Safety Environments Based on Conway's Game o... by joe_the_user on Thursday December 05, 2019 @02:32AM (#21710597)
I am confused by how this is supposed to be useful. It seems like the researchers are defining side-effects as things that "disrupt the world" (of this life game) and training an AI to avoid this.

But this seems like at best one of a whole host unexpected effects one might consider. AI that discriminates in a way that society frowns on might not "disrupt the world" in such a visible fashion.

I don't see how one can get away with an entity doing stuff for you with that entity understanding your model of the world.

Re:SafeLife: AI Safety Environments Based on Conway's Game o... by pde3 on Thursday December 05, 2019 @05:35AM (#21711314)
Yes, this is one specific safety problem -- there are many other RL safety problems that deserve high quality benchmarks too. See eg https://arxiv.org/pdf/1606.06565.pdf or https://medium.com/@deepmindsafetyresearch/building-safe-art... for discussions of the problem space.