Re:Show HN: Whatdoesthiscodedo.com – AI explanations for oth...
by antondd on Wednesday March 15, 2023 @10:38AM
(#35168940)
How would you know that the confidence factors the model gives you are correct or a best guess? Is it event possible with the current LLMs (see the Liar Paradox)?
A better strategy is to use chain of thought prompting or similar techniques, essentially asking the model to explain how it arrived at a solution.
https://github.com/openai/openai-cookbook/blob/main/techniqu...
Currently it looks like it is only capable of writing text that states everything as a matter of pure fact, probably because most training data is written by authors who have already checked that their statements are correct (or at least believe them to be).