Re:Machine learning spots natural selection at work in human...
by ctchocula on Friday November 02, 2018 @12:05PM
(#18364075)
It was shocking to me too that adding prior of human games limited the potential that the go playing computer could have.
Re:Machine learning spots natural selection at work in human...
by ashelmire on Friday November 02, 2018 @01:14PM
(#18364812)
Humans are so bad that fitting the network to our games trapped it in a region of local minima that weren't even close to the ideal, I guess.
Re:Machine learning spots natural selection at work in human...
by vl on Friday November 02, 2018 @01:35PM
(#18364996)
AlphaZero heavily used architecture developed for AlphaGo, an in this sense there is some prior embedded in the architecture, but to jump-start development of this fine-tuned architecture human prior was useful. I.e. path from nothing to AlphaZero would be more difficult then nothing->AlphaGo->AlphaZero, imho.
AlphaZero was likely a curious aside at one point. The idea with AlphaZero is to throw everything out the window. Even the game itself is just generalized into a generic position->transition->terminal state system where most 'simple' (in terms of rules) games can be relatively easy replaced. There was no human heuristics, no human games to go from instead relying entirely on self training, and so on. Of course it ended up that AlphaZero became vastly stronger vastly faster than AlphaGo ever managed to.