News for hackers. Stuff that matters.
Re:Gödel Machine by Voloskaya on Thursday March 28, 2019 @05:12PM (#19516677)
In typical ML you just learn the weights. But the architecture stays fixed, and since we don't have an architecture that can realistically solve well enough all tasks, it shouldn't count as Godel machine.

Meta-learning, where you also learn hyper-parameters (including potentially the architecture) are closer to that, see for example:

- Google Vizier: https://ai.google/research/pubs/pub46180

- Microsoft neural architecture search: https://github.com/Microsoft/nni

But this is still far from a true Godel machine.

Re:Gödel Machine by jimfleming on Thursday March 28, 2019 @05:24PM (#19516786)
Hyperparameter optimization (including architectures) is not really meta-learning. Meta-learning, also known as "learning to learn", is more like MAML[0], RL2[1], L2RL[2], etc.

0. https://arxiv.org/abs/1703.03400

1. https://arxiv.org/abs/1611.02779

2. https://arxiv.org/abs/1611.05763