Re:Google No Longer Automatically Indexes Websites – WTF?
by mjburgess on Monday June 05, 2023 @11:52AM
(#36198111)
It's always making things up. It's fundamentally a coincidence when it gets it right.
That's the nature of associative statistics -- and why this talk of "hallucination" is more marketing PR.
We hallucinate in that our reconstructions of our environment can be caused by internal states (eg., dreaming) -- whereas veridical perceptual states are usually caused directly by the environment.
Here, it's states (ie., the statistical averaging process over its training data) is NEVER caused veridically -- ie., its prompts are never caused by the environment.
Admittedly that was on GPT3, I haven't tried GPT4 as I can't afford it at the moment. No doubt its better, but I'm not sure how much so.