News for hackers. Stuff that matters.
[dead]
Re:Making a racist AI without really trying (2017) by Semiapies on Friday September 21, 2018 @08:51PM (#18043836)
RTFA. It has nothing to do with user ratings, but a direct calculation on the phrases "Mexican restaurant", "Italian restaurant", and "Chinese restaurant" based on the corpus of material.

Go further and follow the links. This example is specifically covered in the linked material. "Mexican" picks up a negative association from the corpus containing frequent mention of "illegal" (listed as a negative term) in close proximity to "Mexican", so the phrase "Mexican restaurant" gets rated less favorably than "Chinese restaurant".

The underlying problem is that we're throwing text at math and pretending that we're building things that understand anything more than word proximity. Human beings that can actually understand context can be horribly biased; software that doesn't have the slightest inkling of context will produce twisted versions of our own biases.

Re:Making a racist AI without really trying (2017) by burlesona on Friday September 21, 2018 @07:25PM (#18043413)
Hmm I didn't get that from the article at all. It felt to me like the author was showing a relatively straightforward explanation of building a system that does not intuitively have racial bias, and then demonstrating that in practice it does anyway, which is kind of surprising.
Re:Making a racist AI without really trying (2017) by tedivm on Friday September 21, 2018 @07:31PM (#18043434)
There was a great discussion at Google Next about this, and it's something my company also thinks a lot about. There are so many ways that bias can creep into algorithms, and it's really important to validate your algorithms against this.

As one non-racial example there was a pneumonia detection model that got some pretty (at least amongst people interested in radiology and deep learning) where the model was detecting the metal badge the hospital was using when taking scans (so every xray from this hospital had a similar graphic on it). This hospital had a higher pneumonia rate as it generally had older people going to it, and because of this the model started giving everyone who went to that hospital a higher likelihood of having pneumonia. So essentially it picked up on the age based bias of the hospital itself.

This is an issue in other types of medical data as well. There have been multiple studies that show doctors are less likely to successfully diagnose a heart attack in women than in men, and that doctors will also underestimate how much pain a black man is in compared to any other category. Those biases end up in the data itself, so if you naively train your models against that data they too will make similar mistakes.

[dead]
Re:Making a racist AI without really trying (2017) by swingline-747 on Friday September 21, 2018 @08:28PM (#18043736)
An unfortunate fact: there are infinitely many kinds and degrees of bias hard-coded in human nature. They cannot be suddenly wished, willed, educated or technologied away, only imperfectly, temporarily overcome with conscious, uphill vigilance.

Anyone whom says they're impartial, unbiased, justice is blind or racism is over.. is lying to you and themselves because such statements, maybe laudible goals, but are unobtainium virtues.

[dead]
Re:Making a racist AI without really trying (2017) by dang on Saturday September 22, 2018 @02:19PM (#18047210)
I looked in the logs. That comment was never [dead] and then unkilled, so I'm not sure what you were seeing?

In any case, you posted this 5 minutes after the comment appeared. That's not enough time to conclude anything about HN, other than that trolls sometimes post here, like they do everywhere on the public internet. It takes time for the community systems (voting, flagging, and moderation) to take effect. It would be nice if we could make them work instantly, but we don't know how to do that. As you can see, the comment is now flag-killed. No single comment can say "a hell of a lot" about a site where 8000 comments appear daily, but since the community functioned as intended in the end, we can count this data point in its favor.

But there's a more important point. Since you're participating here, you're part of the state of the site, and we need you to help take care of it. In the present case that means flagging an egregious comment, instead of feeding it by replying, which only makes the site worse. This is in the guidelines: https://news.ycombinator.com/newsguidelines.html. Had you contributed a flag, you would have helped take care of the problem sooner. Fortunately other users came along and did, thereby improving the state of the site. If you'd be willing to help out like that in the future, we'd appreciate it. But in any case, please don't feed the trolls on HN. The more you do, the more responsibility for the flamewar accrues to you, regardless of how right you are. This is ancient internet wisdom for good reason.

To flag a comment, click on its timestamp to go to its page, then click 'flag' at the top. There's a small karma threshold, currently 30, before flag links appear. This is in the FAQ: https://news.ycombinator.com/newsfaq.html

Re:Making a racist AI without really trying (2017) by tedivm on Monday September 24, 2018 @02:33PM (#18060115)
I had no idea that I could flag comments- I assumed that since there was no link to do so I couldn't, not realizing that I had to go to the comment page itself to do so.

Would it be possible to clean this UI up a bit? I bet I'm not the only user who didn't realize they could do this.

[dead]
Re:Making a racist AI without really trying (2017) by tedivm on Friday September 21, 2018 @07:44PM (#18043499)
All you said is that racism has a basis in reality- you didn't give anything specific to argue against. Why don't you let us all know what issues you think get labelled as "racism" that have a basis in reality? Tell us what racist things you believe if you're looking or people to argue against it.
Re:Making a racist AI without really trying (2017) by rundell1x on Friday September 21, 2018 @07:47PM (#18043509)
I didn't want to explain and I won't bother with it because I know this site is full of people like you and I'm not going to write a few paragraphs of text just to see it all removed in a matter of minutes.

But if you feel I am wrong, or if you feel I should be more specific, you should've said that instead of just wishing my comment never existed.

EDIT: aaaand a mod collapsed the entire thread. So predictable :-)

Re:Making a racist AI without really trying (2017) by tedivm on Friday September 21, 2018 @08:07PM (#18043640)
I don't think there's any issue with wishing racism- and the racists who push it- shouldn't exist.
Re:Making a racist AI without really trying (2017) by sctb on Saturday September 22, 2018 @10:16AM (#18046039)
It was a troll comment: high inflammation and low (no?) information. If you continue we'll ban the account.

https://news.ycombinator.com/newsguidelines.html

Re:Making a racist AI without really trying (2017) by striking on Friday September 21, 2018 @08:24PM (#18043715)
>I won't bother with it because I know this site is full of people like you

>a mod collapsed the entire thread. So predictable

Imagine that, a mod collapsing a thread that nothing good will come of. Maybe you had a point somewhere, but you definitely don't now.

Re:Making a racist AI without really trying (2017) by tedivm on Friday September 21, 2018 @07:22PM (#18043405)
If you actually read the whole article there are other examples as well, such as black names being considered more negative.
Re:Making a racist AI without really trying (2017) by 706f6f70 on Friday September 21, 2018 @07:32PM (#18043445)
Commenting specifically on the black names example: I am skeptical because they replicated the results of a study on humans based on the Implicit Association Test. I would be generous in calling that the Myers-Briggs of this generation, but it's probably even less valuable other in that it's free to take online so a huge data set is easily available.
Re:Making a racist AI without really trying (2017) by Ar-Curunir on Friday September 21, 2018 @07:40PM (#18043474)
Just because humans are biased doesn't mean we have to make our algorithms biased too. This is especially important now that AI and ML are starting to be deployed in non-CS cases.
Re:Making a racist AI without really trying (2017) by swingline-747 on Friday September 21, 2018 @08:35PM (#18043771)
Sorry to disappoint, but that's impossible.

Socialization is an ambiguous, imprecise activity that demands infinitely many judgements, inferences, and preconceived rules & goals.

What can be interpreted as "jerk" behavior can also be caused by "dork" behavior, and vice-versa.

A joke at someone's expense might be expressing affinity for them or dissing them.

Adopting ebonics speech and tone in one context maybe in-group acceptable in one context, but insulting in another.

Ultimately, the algorithms need enough trial-and-error socializing experience to become, for lack of a better term, cool.

Re:Making a racist AI without really trying (2017) by disgruntledphd2 on Saturday September 22, 2018 @05:55AM (#18045316)
Like, the IAT has problems, but it has been shown to have some predictive validity in behaviour. I am entirely unsurprised that the IAT finding replicated in this data, and it actually supports the structural racism explanation propounded by one of the measure's harshest critics.

To be fair to the IAT, while it has very low test-retest reliability and lots and lots of state variance, there's definitely something in the reaction time differences that is meaningful. How meaningful it is, and whether or not it makes any practical difference remains to be determined.

Anyone who hasn't done one, try this link and see how you feel during the process: https://implicit.harvard.edu/implicit/takeatest.html

And at least there wasn't a massive profit motive behind the IAT, at the beginning anyway :)

Re:Making a racist AI without really trying (2017) by incompatible on Friday September 21, 2018 @09:21PM (#18043939)
Judging an individual by membership of categories always introduces bias. Even if Mexican restaurants are for some reason worse on average, say 9/10 are bad, then assuming that a particular restaurant is bad because it's Mexican is biased. Sure, there's a 9/10 chance that it's bad, but it's unfair to treat it as bad without any other evidence.

Insurance companies do this sort of thing all the time.

Re:Making a racist AI without really trying (2017) by thecabinet on Friday September 21, 2018 @10:07PM (#18044074)
No, it’s not unfair to treat it as bad without any other evidence. When all you know is “Mexican restaurant” you judge by that. You can’t live your life only making judgements once you have “all” the facts, as if that’s even possible. There seems to be this unspoken assumption that the thought process must be stereotypes leading to death camps. It is possible to say, “Based on my life experiences thus far I do not enjoy the company of black people/Mexican food/whatever” without thinking “and therefore we should kill all those people”.
Re:Making a racist AI without really trying (2017) by incompatible on Friday September 21, 2018 @10:21PM (#18044112)
The bias may be justified to you (since you just want to get a good meal somewhere and don't want a 9/10 chance that it's bad), but it's still unfair to the perfectly good Mexican restaurants that you won't eat at.
Re:Making a racist AI without really trying (2017) by thecabinet on Saturday September 22, 2018 @12:41PM (#18046688)
Fair is a word for children. It’s unfair to the Italian restaurant that you’re eating Mexican. It’s unfair to the grocer that you’re eating at a restaurant. It’s unfair that you’re buying groceries instead of seeds. As adults have told children for thousands of years, life isn’t fair.
Re:Making a racist AI without really trying (2017) by int_19h on Saturday September 22, 2018 @09:47PM (#18048980)
Ethologists disagree - adults very much care about fairness, as well. Arguably, most of our politics is about that.
Re:Making a racist AI without really trying (2017) by thecabinet on Sunday September 23, 2018 @12:06PM (#18051680)
Sure, but much of the fairness we argue about as adults is due to fundamental disagreements about morality or how the world should work. “It’s not fair that tax cuts benefit the wealthy.” Republicans think it’s not fair to take money from people who earned it. Democrats think it’s not fair for some people to have more wealth than they’ll ever use while others have so little. But the concept of “fairness” doesn’t do anything to help us resolve that disagreement.
Re:Making a racist AI without really trying (2017) by int_19h on Monday September 24, 2018 @04:41AM (#18055980)
But at the same time, there are some aspects of fairness that do appear to be innate - as in, they're observed in very small children regardless of the culture they're from, in experiments where they're asked to share (or not share) something that they have, or assess how someone else shared theirs. Extreme "wealth inequality" - as defined, say, through the amount of candy each child has - is universally seen as unfair, for example, although you also have to account for parochial altruism. Bonobos also demonstrate similar attitudes.

So it appears that our evolution as social species has set some hard boundaries. Abstract ideologies can go beyond them, of course, but their real-world success seems to correlate to some extent with how much they do or not - I would argue that ancap definition of "fair" is so unpopular precisely because it's so out-of-bounds wrt our biology.

Re:Making a racist AI without really trying (2017) by int_19h on Monday September 24, 2018 @04:33AM (#18055951)
It doesn't need to help us resolve the disagreement to be useful to explain why the disagreement is there in the first place, though.

And, in practice, there are large groups of people who do share the broad definitions of "fairness", and therefore saying that something is fair or unfair is useful to communicate the idea within those groups. This is not something that people really like to see put quite so explicitly, but when we say something "this should not be so because it is unfair", it carries an implicit "... and I don't care what those who disagree with me about what 'unfair' means think".

Re:Making a racist AI without really trying (2017) by incompatible on Saturday September 22, 2018 @08:42PM (#18048764)
So racist AIs may be unfair to some people, but it doesn't matter because life is unfair?
Re:Making a racist AI without really trying (2017) by crooked-v on Friday September 21, 2018 @08:35PM (#18043772)
Society is biased. Even assuming purely a statistical averaging of outliers, there are, for example, enough open racists in the US that a crowd of them decided that marching through Charlottesville with tiki torches was a good idea.
Re:Making a racist AI without really trying (2017) by Ar-Curunir on Friday September 21, 2018 @07:38PM (#18043465)
There are as many shitty pizza/burger joints and diners as there are shitty restaurants of any other kind.
Re:Making a racist AI without really trying (2017) by Mountain_Skies on Friday September 21, 2018 @08:39PM (#18043791)
Cilantro is a prominent ingredient in Mexican cuisine. It is also notoriously difficult to clean compared to other produce. Add in that it is prepared and served uncooked and you have a food with a higher likelihood of harboring things that will make you ill. Compare that to something like BBQ that is cooked for extended periods of time and the result isn't bias, it's microbiological reality.

If Mexican restaurants are cited more for having ill patrons, it might simply be due to the cuisine using preparation methods that lend themselves more easily to distributing contamination than many other cuisines. No bias necessary.

Re:Making a racist AI without really trying (2017) by forapurpose on Saturday September 22, 2018 @01:05AM (#18044554)
Really? Mexican food is inherently a health risk because of cilantro?
Re:Making a racist AI without really trying (2017) by thrower123 on Friday September 21, 2018 @09:40PM (#18043994)
Also, for a significant portion of the population, cilantro tastes just like harsh lye soap, and will render anything contaminated with it edible but extremely unappetizing.
Re:Making a racist AI without really trying (2017) by Z8064k on Friday September 21, 2018 @08:22PM (#18043704)
A statement like this has no backing at all. And it's exactly what the parent comment was talking about when they said: "a bias toward thinking society is biased."

We can't just conclude that x is true because it seems more fair that it would be true. The universe isn't necessarily fair and equal.

We can lie to ourselves and our machine learning models about things like: "there must be an equal number of bad restaurants within each genre of restaurant." But that won't make it true. It will just make our models work less well.

Re:Making a racist AI without really trying (2017) by manfredo on Friday September 21, 2018 @08:28PM (#18043731)
Are there? It's not entirely inconceivable that certain themed restaurants are worse than average in a given area. It wouldn't be surprising if seafood restaurants aren't as good in areas far from the coast, since ingredients need to travel a longer distance. Even if we assume that there is no degredation of quality, the added logistical cost would mean that savings need to be made elsewhere in order to provide a meal at the same pricepoint.