News for hackers. Stuff that matters.
Re:Towards deep symbolic reinforcement learning by Eridrus on Saturday October 15, 2016 @08:08PM (#12716205)
You're definitely right that we've found joint training to be highly useful and having a neural net simply act as a feature extractor is unsatisfying, but I think that success at unifying neural nets with symbolic or even non-learning systems would be a big step forward. This isn't it, but even the alphago work relied on Monte Carlo tree search, so I wouldn't dismiss this out of hand.
Re:Towards deep symbolic reinforcement learning by hacker42 on Saturday October 15, 2016 @08:54PM (#12716320)
But MCTS works in AlphaGo because the 'world' can be fully represented by a tiny state vector which fits a billion times into primary memory these days. The real difficultly of real world problems is the ill-defined, mutable, high-dimensional and partially observable state space.
Re:Towards deep symbolic reinforcement learning by Eridrus on Saturday October 15, 2016 @10:12PM (#12716495)
I'm merely pointing out that "all neural everything" is not always the best approach despite joint training being very appealing.