I honestly doubt very much that a reinforcement learning based approach can scale to the breadth of facts that such a model would need to know about. Is there any reason that using a rewards-based approach to cover one set of facts would in any way generalize to a completely different area of expertise (say, rewards for true facts in mathematics generalizing to questions about literary criticism, or new world cultures), or would you have to include (manually curated) rewards for all areas?