Thanks for the great comment. I agree and many of the points you're making here were touched on by John or in the QA section at the end, with the exception I think of the insight about the identity of the questioner. I think that can be solved pretty easily though just by asking people to add their age and country when signing up for a ChatGPT account. They'll probably have to add age anyway for legal reasons.

For the rest, it rapidly turns into the same set of problems you face when evaluating the truthfulness of any human authored answer. This is going to turn into a fight between people who want a Star Trek style truth machine that is far better than humans at generating true claims, people who think they want such a machine but don't (plenty of unpleasant truths out there), and people who are satisfied with "decent human" level honesty and integrity. Or maybe AI can achieve slightly better than human, I think even just the current set of improvements and ideas is likely enough to get there and OpenAI have already made a lot of progress in training opinions out of their LLM. A lot of why people get riled up about truth is the common practice of stating opinions as facts. GPT-4 is extremely reluctant to take positions on anything, which may yield unsatisfying prose but is an obvious and good move for turning down the heat on truthfulness fights.