Re:Show HN: StonksGPT – A Natural Language search tool for S...
by netruk44 on Thursday June 01, 2023 @03:08PM
(#36155893)
(I'm going to use the word 'word' instead of 'token' because that's more intuitive to understand)
I can't speak for this model specifically, but the way GPT works is by first coming up with a list of likely words along with their probabilities of being the next word to follow from the current state of the prompt. Then it uses some math (Top-P controls how much of that list to use, temperature controls how strongly it should prefer the 'most likely' words as opposed to the lesser likely ones) to randomly select the next word. Repeat until you're happy with the length.
In this way, the model knows how likely the word it's about to choose is, but that says nothing about whether it's hallucinating or not. All the words in the list are equally 'true' to the model.
So, no. Not currently. All LLM's know is how likely a word is to appear next to another word, given the preceding X,000 words.
I can't speak for this model specifically, but the way GPT works is by first coming up with a list of likely words along with their probabilities of being the next word to follow from the current state of the prompt. Then it uses some math (Top-P controls how much of that list to use, temperature controls how strongly it should prefer the 'most likely' words as opposed to the lesser likely ones) to randomly select the next word. Repeat until you're happy with the length.
Visual example: https://i.imgur.com/FvoSiC7.png
In this way, the model knows how likely the word it's about to choose is, but that says nothing about whether it's hallucinating or not. All the words in the list are equally 'true' to the model.
So, no. Not currently. All LLM's know is how likely a word is to appear next to another word, given the preceding X,000 words.