Maybe you could make a companion module that pre or post processes the GPT-* outputs to slot in facts using a less AI-y but more accurate knowledge graph system? There are things at google or something like Wolfram Alpha that could provide those inserts perhaps.
That's definitely been my big hang up about the usefulness of Bing Chat or ChatGPT for answering questions. If you actually care about the truth of what you're asking you have to go do a lot of the same searching you would have to do to look up the answer in the first place. At best it could provide an idea of what to search when you don't know the language to use to find something, which is often a roadblock for when I'm learning a new system or service.
In a few cases, I've seen it give citations to things that clearly never existed.
For example, I asked it for US auto-pedestrian death statistics. It printed out a nicely formatted table.
Then, I asked it for a source. It pointed me to a specific table on a dot.gov page. The table didn't exist and, according to the Wayback Machine, it never did.
I ended up finding the information the old-fashioned way, and numbers that it gave were way off.
I suspect the majority of folks won't be bother to fact check the data it returns. It's going to be a problem.
It got the general field-of-work correct (which is niche). Yay! Everything else, it hallucinated -- my school, my work history, etc.
Truly amazed me that such a tiny part of the internet landed in its model.
I would love that Bing provide context on where it found the information and provide an assessment on how reliable it is, but I am sure it'll be gamed by SEO very quickly. Plus a demo of this, even through it's useful, wouldn't look impressive as it lacks confidence.