News for hackers. Stuff that matters.
Re:Everyone wants to do the model work, not the data work [pdf] by collyw on Monday March 29, 2021 @06:35AM (#26619736)
If you "carefully select your sources" then you aren't training on "random images from the web".

If you are using random images from the web, there is a decent chance that you will get a result like this.

https://www.theguardian.com/commentisfree/2021/feb/03/what-a...

The Guardian labels it sexist. I assumed that it was because the majority of young attractive women on the internet are posting bikini pictures.

Re:Everyone wants to do the model work, not the data work [pdf] by gwd on Monday March 29, 2021 @07:10AM (#26619980)
> The Guardian labels it sexist. I assumed that it was because the majority of young attractive women on the internet are posting bikini pictures.

They're both true at the same time, which is exactly the point. The people in the article in the paper weren't trying to teach their neural net that men usually wear suits and women usually wear bikinis, but they did. They only noticed because the failure mode was really obvious. In some other situation, the exact same kind of sexist bias might exist in the data -- and important decisions, affecting people's lives, may be made -- without anybody noticing first.