Re:Conservatives Are Panicking About AI Bias, Think ChatGPT ...
by dorchadas on Tuesday January 17, 2023 @02:04PM
(#34417093)
There's also bias in the data itself. That's the difficult thing to avoid. Even down to how we phrase a question, who we collect the data from, it all introduces a bias unless we're literally harvesting all data from every human being and using that for our models. There's no way to get rid of the bias, even if we take out the nudges.
[ Parent
| on HN ]
Re:Conservatives Are Panicking About AI Bias, Think ChatGPT ...
by wizeman on Tuesday January 17, 2023 @02:11PM
(#34417182)
How about you select a representative (i.e. random and statistically significant) sample of the population and then ask them their opinions about certain (especially controversial) parts of your data, and then weigh your data according to these opinions?
That's just an idea that occurred to me (in 30 seconds of thought) which could probably make the training data significantly more unbiased.
But I'm sure there are research scientists who can come up with better methods for sampling data in a more unbiased fashion.
Note that this is not an all or nothing approach. Your training data could presumably be 100% biased or 0% biased, but also any value in-between.
The goal is to try to make it as close to 0% biased as feasible, given whatever effort you're comfortable expending.