Re:DeepSeek R1: Open Weights, Hidden Bias
by sylware on Thursday January 30, 2025 @12:09PM
(#42879750)
The bias is baked into the open weights, namely happening on self-hosted 671B LLM??
[ Parent
| on HN ]
Yes -- we observed this behavior on both the open-source open-weights 671B model as well as the DeepSeek web app.
Re:DeepSeek R1: Open Weights, Hidden Bias
by sylware on Thursday January 30, 2025 @05:54PM
(#42883043)
Weird, because I got some deepseek feedback where it was openly critical and explicit about the authoritative regime of china. I really thought it was the "deepseek web app" only.
Then I have mixed signals about this.
We're working on a follow-up post focused on our analysis of the open-source open-weight 671B model. What we're seeing is that questions related to the Chinese government produce an empty chain-of-thought followed by pro-Chinese-government talking points.
Re:DeepSeek R1: Open Weights, Hidden Bias
by sylware on Saturday February 01, 2025 @05:32AM
(#42897389)
It is too late, I got mixed signals.
This is going to be very hard to trust anything about it anymore, unless running the 671B locally an my own systems.
We ran the 671B locally and found a ton of bias. See part 2 of our analysis here: https://news.ycombinator.com/item?id=42918935
Happy to send you the dataset if you'd like! Please reach out to our email linked in the post.