Re:How to recognize AI snake oil [pdf]
by roywiggins on Tuesday November 19, 2019 @08:25PM
(#21580279)
It's how in Rock Paper Scissors you can probably do better against a smart opponent by playing randomly than by trying to trick them. At least they can't get in your head, because there's nothing there. You won't do better than chance, but at least you can't do much worse.
Re:How to recognize AI snake oil [pdf]
by sdenton4 on Tuesday November 19, 2019 @09:02PM
(#21580481)
So, use a random strategy and measure the entropy of your opponent's behavior. And modify accordingly, as needed.
A lot of the best ml right now is effectively about making better conditional probability distributions. You always get random output, but skewed according to the circumstances, and sharp according to confidence in the result.
Beyond reinforcing our tendency to project, as you say, a personal history on random behavior, it also highlights what a few other people have commented: that in many non-cooperative situations a committed random strategy is extremely effective, and perhaps more effective than a biased, seemingly "rational" strategy. (For another example, I believe Henrich's "The Secret Of Our Success" discusses the possible adaptive benefits of divination as a generator for random strategies among early societies.)