Re:ChatGPT can now see, hear, and speak – openai.com
by TerrifiedMouse on Thursday September 28, 2023 @07:09AM
(#37687934)
> a temp of 0 doesn't reduce hallucinations.
I never said it did. If it did we wouldn’t be complaining about hallucinations as we can just turn them off at will by setting the temp to zero.
> LLMs internally know when they are hallucinating/taking a wild guess.
No they don’t. If they did we would be able to program them to not do so.
I would argue that wild guesses are all LLMs are doing. They practically statistically guess their way to an answer. It works surprisingly well a lot of the time but they don’t really understand why they are right/wrong.
P.S. LLMs are kind of like students who didn’t study for the test so they use “heuristics” to guess the answer. If the test setter is predictable enough, the student might actually get a few right.
I never said it did. If it did we wouldn’t be complaining about hallucinations as we can just turn them off at will by setting the temp to zero.
> LLMs internally know when they are hallucinating/taking a wild guess.
No they don’t. If they did we would be able to program them to not do so.
I would argue that wild guesses are all LLMs are doing. They practically statistically guess their way to an answer. It works surprisingly well a lot of the time but they don’t really understand why they are right/wrong.
P.S. LLMs are kind of like students who didn’t study for the test so they use “heuristics” to guess the answer. If the test setter is predictable enough, the student might actually get a few right.