Re:DeepSeek's Hidden Bias: How We Cut It by 76% Without Perf...
by UltraSane on Thursday January 30, 2025 @09:15PM
(#42884153)
"what's the probability distribution of each answer being correct?"
Being able to reason like this is almost a superpower. It is so effective it makes a lot of arguments seem silly.
Re:DeepSeek's Hidden Bias: How We Cut It by 76% Without Perf...
by throwE472745 on Thursday January 30, 2025 @10:14PM
(#42884412)
And again, you are answering an assumption not the actual question asked.
To me, these answers are framed incorrectly. I don't think in terms of "which answers are correct" but in terms of "what's the probability of each answer being correct?"
And the overall distribution of those probabilities comes from all my priors about the situation. One such prior is that age is positively correlated with forgetfulness. It's something that I know because I see it every day, and therefore I internalized it as true. I know it's not true every single time, but it may as well be.
It's a heuristic, and a very good one: the chance that I'll be wrong if I say that the 77 year old is forgetful is extremely low. So I feel very confident in giving that answer from a risk/reward perspective.