News for hackers. Stuff that matters.
Re:Build your own MENACE (matchbox-powered machine learning ... by eternityforest on Sunday February 27, 2022 @04:08PM (#30492515)
What would this algorithm be in modern day machine learning terms? Is it similar to anything we have now?
Re:Build your own MENACE (matchbox-powered machine learning ... by gwern on Sunday February 27, 2022 @04:38PM (#30492792)
I think it would be most similar to tabular Q-learning. It has some weaknesses due to its simplicity, like not decaying the learning rate (you always add/remove from a fixed number of matches; maybe if you used an unbounded number of matches it'd be equivalent?) or having any exploration built-in, so it doesn't enjoy the guarantees tabular Q-learning does like converging to the optimal game play - MENACE would presumably jitter around the optimal strategy if it approached it at all.