Re:AI Blindspots – Blindspots in LLMs I've noticed while AI ...
by habinero on Friday March 21, 2025 @07:55PM
(#43441966)
You're Clever Hans-ing yourself into thinking there's more going on than there is.
Machine learning models can do this and have been for a long time. The only thing different here is there's some generated text to go along with it with the "reasoning" entirely made up ex post facto
Re:AI Blindspots – Blindspots in LLMs I've noticed while AI ...
by troupo on Saturday March 22, 2025 @05:18PM
(#43448711)
> Then how do you explain the interaction I had with chatgpt just now?
Predominantly English-language data set with one of the most famous suspension bridges in the world?
How can anyone explain the clustering of data on that? Surely it's the model of the world, and thinking, and neurons.
What happens if you type "most famous suspension bridges in the world" into Google and click the first ten or so links? It couldn't be literally the same data? https://imgur.com/a/tJ29rEC
The link mentions "a feature that triggers on the Golden Gate Bridge".
As a test case, I just drew this terrible doodle of the Golden Gate Bridge in MS paint: https://imgur.com/a/1TJ68JU
I saved the file as "a.png", opened the chatgpt website, started a new chat, uploaded the file, and entered, "what is this?"
It had a couple of paragraphs saying it looked like a suspension bridge. I said "which bridge". It had some more saying it was probably the GGB, based on two particular pieces of evidence, which it explained.
https://imgur.com/a/sWwWlxO
> The model recognizes nothing, and groups nothing
Then how do you explain the interaction I had with chatgpt just now? It sure looks to me like it recognized the GGB from my doodle.