Re:Replace OCR with Vision Language Models
by thatjoeoverthr on Thursday February 27, 2025 @08:35AM
(#43194232)
More broadly, it’s not trained to have any self awareness and this is a factor in other “hallucinations”. If you ask, for example, to describe the “marathon crater”, it doesn’t recognize that there’s no such thing in its corpus, but will instead start by writing an answer (“sure! The marathon crater is..”) and freestyle from there. Same if you ask it why it did something, or details about itself, etc. You should access one directly (not through an app like chatGPT) and build a careful suite of tests to learn more. Really fascinating.
[ Parent
| on HN ]
Re:Replace OCR with Vision Language Models
by _delirium on Thursday February 27, 2025 @12:45PM
(#43196612)
Yes, there’s research showing that models’ self-assessment of probabilities (when you ask them via prompting) don’t even match the same models’ actual probabilities, in cases where you can measure the probabilities directly (e.g. by looking at the logits): https://arxiv.org/abs/2305.13264
Re:Replace OCR with Vision Language Models
by anon291 on Friday February 28, 2025 @12:06AM
(#43201901)
Logits are not probabilities... at least not in the way you understand probability. Probabilities mathematically are anything that broadly behaves like a probability, whereas colloquially probabilities represent the likelihood or the preponderance of a particular phenomenon. Logits are not either of those.