News for hackers. Stuff that matters.
Re:Growing Neural Cellular Automata: A Differentiable Model ... by m_que on Tuesday February 11, 2020 @03:46PM (#22302656)
Dang! I started working mid-last year on practically exactly this as a side project (was going to call the paper "Towards the horse", if you get the reference :) ). Congratulation for making it work, I am really psyched. Can you remember what triggered the motivation to work on this? Somehow I remember there being something on reaction-diffusion equations on HN around that time. Had you tried to use a single Laplace operator instead of two Sobel filters? My approach is to model the reaction-diffusion as a sum of 1x1-convolution (reaction) and a depthwise 3x3 convolution with a fixed kernel multiplied by a learnable constant (diffusion). However, for this to work, a single seed pixel obviously will not work. Any thoughts?
Re:Growing Neural Cellular Automata: A Differentiable Model ... by eyvindn on Wednesday February 12, 2020 @06:26AM (#22307924)
Diffusion-reaction systems were an inspiration in general. Using a Laplace operator (or the discretised equivalent for our 2D grid) might have trouble learning to generate these patterns - the Laplacian wouldn’t always provide unique information as to where a cell might be based on its neighbours. It’s possible the network would learn to exploit the hidden channels to bypass this directional invariance. Starting from a single pixel in such a setting would indeed need some mechanism to break the symmetry (stochastic updates as used here, for instance).
Re:Growing Neural Cellular Automata: A Differentiable Model ... by m_que on Wednesday February 12, 2020 @02:13AM (#22306612)
Now having scrolled down to the bottom of the papaer, I have seen a section on the genesis of the idea.