DeepSeek's Hidden Bias: How We Cut It by 76% Without Performance Loss

Re:DeepSeek's Hidden Bias: How We Cut It by 76% Without Perf... by Manuel_D on Wednesday January 29, 2025 @06:13PM (#42872568)

But when the text does indicate that our hypothetical 78 year old is forgetful, the de-biased model is less accurate. Check the two rightmost columns under "bias unlearning results".

The de-biased model was less likely to give the biased answer in ambiguous prompts, but at the expense of reluctance to give the "biased" response when the prompt indicates that it was true.

[ Parent | on HN ]

Re:DeepSeek's Hidden Bias: How We Cut It by 76% Without Perf... by notahacker on Wednesday January 29, 2025 @06:36PM (#42872808)

Yes, it has the standard LLM trait that when you nudge it to stop being confidently wrong based on insufficient information, it also tends to be less assertive when it actually has sufficient information.

But I'm not sure why anyone would prefer a model which parses sentences as containing information that isn't there 30-50% of the time to a model which gives false negatives 4-10 %age points more often when given relevant information (especially since the baseline model was already too bad at identifying true positives to be remotely useful at that task)

[ Parent | on HN ]