News for hackers. Stuff that matters.
Re:Tool AIs want to be agent AIs by gwern on Wednesday December 21, 2016 @05:54PM (#13233376)
> learn gradient descent by gradient descent.

As far as 'learning gradient descent by gradient descent' goes, I think it's still an open question if a tiny RNN actually can improve meaningfully over ADAM etc :) I don't recall the paper showing any wallclock times, which suggested to me that the RNN was way slower even if it trained faster. The individual parameter adjustments are so low in the hierarchy of actions that the value may be minimal compared to higher up like architecture design.

Re:Tool AIs want to be agent AIs by AlexCoventry on Thursday December 22, 2016 @06:40AM (#13236601)
What paper are you referencing?
Re:Tool AIs want to be agent AIs by detaro on Thursday December 22, 2016 @06:44AM (#13236615)
I assume this https://arxiv.org/abs/1606.04474 (since the title is basically the quoted text)