But the paper is nice to have in case anyone is suggesting such a scheme. Is anyone? Hopefully not…
Outside of social media like bubbles, human learning in fact has a sort of oracle providing correct examples: the world around us. In fact, if you provide a world for an AI to interact with, such a game like Go, then it can in fact learn simply interacting with versions of itself and the world.
Put a little more simply, only talking will not lead to new knowledge if there is no testing of ideas or conclusions involved. If anything, extended talking without feedback often leads to damaging rumination and/or possible misinformation.
If this notion is correct, actively limiting and directing the sorts of inputs we give ourselves could help us improve our knowledge and abilities.
The way to mimic it would be to self-train and add new crap onto the training continuously to simulate world experience, otherwise things get a bit too deterministic and you end up running an expensive minimization problem.
I feel like humans for the most part don't just blindly update their beliefs based on whatever thought or action they just did. Humans will often take some sort of action based on their thoughts and then observe how successful their action was. Then they can update based on the feedback signal.