Re:Deep learning: a critical appraisal
by RoboTeddy on Monday June 04, 2018 @04:35PM
(#17232139)
This question isn't silly! People have actually trained neural networks to generate other neural networks. The "designer" network is trained using reinforcement learning, with a reward signal that depends on the efficacy of the networks it creates.
See: Neural Architecture Search with Reinforcement Learning (https://arxiv.org/abs/1611.01578)
It looks like they trained the "designer" network by trainning 15,000 deep learning models (800 at a time in parallel over 800 GPUs)