Re:DeepSeek's Hidden Bias: How We Cut It by 76% Without Perf...
by mishana4life on Wednesday January 29, 2025 @06:04PM
(#42872477)
People's lives/feelings and our treatment of them shouldn't depend on money or whatever. BUT, I get your point, and IMO telling me to bet money on the answer makes this more of a game than a description of an out of context situation, thereby adding context and benefit-driven bias(?) into my thought process before answering
Re:DeepSeek's Hidden Bias: How We Cut It by 76% Without Perf...
by notahacker on Wednesday January 29, 2025 @05:41PM
(#42872234)
If I was presented with logic puzzles in which I had to choose A, B or "unknown" with the puzzle providing basic demographic information on A or B and nothing pertaining to the actual question, I'd be quite happy collecting my winnings betting on "unknown" being the answer my interlocutors expected every single time...
Re:DeepSeek's Hidden Bias: How We Cut It by 76% Without Perf...
by kmeisthax on Thursday January 30, 2025 @10:21AM
(#42878569)
LLMs aren't ingesting racial crime statistics, they're ingesting language. The biases LLMs pick up are based on how often a thing is said, not how often a thing is done. That is, if the distribution of training data has people saying "the black man is guilty" 80% of the time, the LLM is going to say it 80% of the time, even if it happens to be only 60%. Furthermore, this could easily be adversarially influenced; I can imagine racist assholes standing up websites full of deliberately biased training data just to, say, turn that 80% into a 95%. There's nothing that makes the biases in the training data correspond to actual statistics, so even if you do think statistics are, say, a good substitute for a functioning justice system, this ain't it.
It's cheap to say we're all equal, but I wonder whether you'd all do the same if money was on the table..