News for hackers. Stuff that matters.
Re:A Way to Detect Bias by hibikir on Saturday October 31, 2015 @06:26PM (#10484474)
The problem here is language and what our actual objectives are.

When people complain about bias, they are not really talking about mathematical bias, but about something else: Their idea of fairness. They are talking about discrimination. And when we are discussing that, we can't really think about whether rules are applied fairly or not, but whether the rules produce the outcomes that we want.

Let's go for a ludicrous example: We'll accept all applicants whose IQ is higher than their weight in pounds. We'll be explicitly discriminating against heavy people, but at the same time, we have pretty clear implicit biases against men, and ethnic groups who tend to be taller. We might as well have said that we prefer children and Japanese women. There's no need for mathematical bias: The bias comes from the rule selection.

So, in your example, if our actual objective is to graduate an even amount of people from groups A and B, we have to, explicitly, make it easier for group B to get the scholarship. And many times organizations have objectives like that.

As a more real example, let's consider a police department. If the objective is to have a racial makeup that represents the community, and different races have different drop-out rates, the candidate selection will prefer one kind over the other, precisely to counter the drop-out differential.

So when regular people, and not mathematicians, discuss bias, the mathematical definition is unimportant. The one important thing is our stated objectives.

Re:A Way to Detect Bias by ericjang on Saturday October 31, 2015 @08:35PM (#10484897)
Your comment makes sense; indeed, fairness in selection process does not imply that people aren't being discriminated against. For instance, the SAT is fair, but denies those with less opportunities a chance to get into top-tier schools. I can get on board with that.

> We can't really think about whether rules are applied fairly or not, but whether the rules produce the outcomes that we want.

This is a more explicit way of phrasing an attitude that I've noticed in my community (a liberal U.S. university). However, I don't think it's obvious that this is the right principle to uphold.

I squirm with discomfort at the idea that we will only support "fairness" and empirical data to the extent that it is applicable to the outcome that we personally desire. This seems to imply that all evaluation metrics are "biased", until we can find a measure that selects equal representation across all demographics, regardless of the size of applicant pool or ability distribution among that pool.

What outcomes, exactly, do we want? More representation of under-represented groups? How does this relate to the goal of maximizing return on the portfolio? What does this mean for people who want a "meritocracy" (if such a thing can exist)?

Thoughts?

Re:A Way to Detect Bias by Retric on Saturday October 31, 2015 @09:55PM (#10485100)
It's not easy to tell when bias shows up. Collage rankings might look like an unbiased formula, but it's selected so the 'top' schools end up being highly ranked instead of measuring useful things. Things like a high faculty to student ratio don't actually directly have much impact but it's the kind of stat easily gamed by 'top' schools so it's gotten some sort of mythic importance even if these people don't actually teach undergrad classes.

You can find the same inherent bias in many walks of life. Many of the hurtles to becoming a Doctor have nothing to do with being a good Doctor there just there to ensure the right kinds of people get into and out of the program.

Re:A Way to Detect Bias by kiyoto on Saturday October 31, 2015 @07:27PM (#10484675)
What surprised me a bit is that pg decided to use the word "bias" without any clarification, considering his background in computer science and AI.

Anyway, I think pg's whole argument is rather moot because the three assumptions that he states are incredibly difficult to measure (Part of the reason why it is very difficult to argue for or against affirmative actions without coming across as "biased").

Re:A Way to Detect Bias by gozo on Saturday October 31, 2015 @11:12PM (#10485279)
Unfortunately I think this is a problem with many of his essays. They often present a very specific argument with reservations, which makes the argument very hard to disagree with since you have to argue relevance which requires a lot more insight. It's therefor taken as truth by the readers, even if the original argument don't support their conclusion. In general I think they should be seen as opinion pieces rather essays. I have a hard time seeing many of them being up to e.g. basic university standard.
Re:A Way to Detect Bias by 55555 on Saturday October 31, 2015 @06:44PM (#10484523)
Great comment. There are two types of fairness, (a) fair rules, and (b) fair outcome.
Re:A Way to Detect Bias by baddox on Saturday October 31, 2015 @08:27PM (#10484877)
Which are essentially two of the big branches of normative ethics: deontology and consequentialism.
Re:A Way to Detect Bias by rewqfdsa on Saturday October 31, 2015 @07:24PM (#10484670)
Favoring fair outcome over having fair rules is against everything I believe. We should not strive for a participation trophy culture.
Re:A Way to Detect Bias by gozo on Saturday October 31, 2015 @10:20PM (#10485170)
"Favoring fair outcome over having fair rules"

Which essentially no one does? People favor fair outcome because they don't think the rules are, or can be, fair and often as a proxy for rules becoming more fair.

Re:A Way to Detect Bias by humanrebar on Sunday November 01, 2015 @08:37AM (#10486360)
I disagree. Rephrasing the tradeoff a little, Westerners are not willing to accept bad outcomes as a matter of course. It is probably objectively fair for individuals to stop wearing seatbelts or to "responsibly" pursue a meth habit, but those things are still illegal.

The "fair" rules would probably be to let people do stupid things and accept their own consequences, but Western culture is not willing to let houses burn down because people didn't buy into the local fire department co-op.

Re:A Way to Detect Bias by iand on Saturday October 31, 2015 @08:04PM (#10484798)
This well-circulated image shows that making everyone a winner has merit in some circumstances.

http://static.themetapicture.com/media/funny-equality-justic...

The left hand side is fair rules, the right hand side shows a fair outcome

Re:A Way to Detect Bias by bmmayer1 on Saturday October 31, 2015 @08:41PM (#10484915)
It's never a bad idea to think about how these ideas play out when taken to their logical conclusion.

Kurt Vonnegut on the subject: http://www.tnellen.com/cybereng/harrison.html

Re:A Way to Detect Bias by Asbostos on Saturday October 31, 2015 @09:18PM (#10485011)
That's alright if the goal is to help the individuals, like welfare. But it's not OK if the goal is to get people to do the most extreme things, like job applicant selection looking for a "best" applicant or baseball team for a best player. A person who can be successful without needing as many boxes to stand on as others.

Don't forget that it's these "best" people who add a vastly disproportionate amount of value to the world. They're the ones who invent new technology and discover new science. We all benefit greatly from their success.

Re:A Way to Detect Bias by vog on Saturday October 31, 2015 @08:14PM (#10484840)
The link is down (shows a jpeg with a single white pixel), but I guess that one is the same:

http://themetapicture.com/points-of-view/

Re:A Way to Detect Bias by getsat on Sunday November 01, 2015 @12:16PM (#10487124)
It's really more like this version of the image: http://i.imgur.com/DqKXPF3.png
Re:A Way to Detect Bias by rewqfdsa on Saturday October 31, 2015 @08:10PM (#10484823)
The baseball game in the image wouldn't be worth if equality of outcome were the rule for baseball team tryouts. The entire game is based on fair competition under the rules pushing participants toward excellence.

Inequality of outcome is the entire reason we see baseball played at a high level. When you demand equality of outcome regardless of talent or effort, you're asking for society to stagnate. You're asking for pervasive mediocrity. You're asking for us to kill effort and motivation. No thanks.

Re:A Way to Detect Bias by pygy_ on Saturday October 31, 2015 @11:16PM (#10485283)
You're beating a straw man. He said in some circumstances.
Re:A Way to Detect Bias by rewqfdsa on Saturday October 31, 2015 @11:44PM (#10485338)
Yet he didn't list any or describe any criteria for evaluating them. The "in some circumstances" bit was just a way to weasel out of potential objections.
Re:A Way to Detect Bias by pygy_ on Sunday November 01, 2015 @04:23PM (#10488370)
I thought the example was pretty obvious.
Re:A Way to Detect Bias by lexcorvus on Saturday October 31, 2015 @07:46PM (#10484735)
Indeed. The problem is that people frequently infer unfair rules from unequal outcomes, without taking into account the possibility of systematic group differences.

    Alan: I believe in equality of opportunity, not equality of outcome.

    Bob:  How do you know there isn't equality of opportunity?

    Alan: Well, just look at how unequal the outcomes are!
At this point, Bob would be wise to change the subject, because if he pressed on, he might get this:

    Bob:  Can you give me an example?

    Alan: Group X is underrepresented in Field Y.

    Bob:  Maybe Group X isn't as good at Field Y.

    Alan: What? That's racist and/or sexist!
And if Bob were to make a comment to this effect on Hacker News, he's probably get downvoted. This is because most people agree with Alan, and many of them abuse their downvote privileges to punish ideas they disagree with rather than those that don't further the discussion. This degrades the quality of discourse, but at least it helps reassure the downvoters that they aren't racist and/or sexist.
Re:A Way to Detect Bias by nl on Sunday November 01, 2015 @06:07AM (#10486091)
Bob: Can you give me an example?

nl: Sure.

To overcome possible biases in hiring, most orchestras revised their audition policies in the 1970s and 1980s. A major change involved the use of blind' auditions with a screen' to conceal the identity of the candidate from the jury. Female musicians in the top five symphony orchestras in the United States were less than 5% of all players in 1970 but are 25% today. We ask whether women were more likely to be advanced and/or hired with the use of blind' auditions. Using data from actual auditions in an individual fixed-effects framework, we find that the screen increases by 50% the probability a woman will be advanced out of certain preliminary rounds.[1]

Bob: What? But that doesn't count because...

[1] http://gap.hks.harvard.edu/orchestrating-impartiality-impact...

Re:A Way to Detect Bias by lexcorvus on Sunday November 01, 2015 @06:18AM (#10486107)
I didn't say there are no valid examples of bias, just that many people assume unequal outcomes must result from unequal opportunity, ignoring the possibility of real group differences. Surely you know many real-life Alans who see bias every time a particular Group X is underrepresented in Field Y. Moreover, the values of X aren't random; you'll almost never hear complaints of bias regarding, say, trash haulers, or NFL cornerbacks. (But NFL quarterbacks—ah, plenty of bias there!)
Re:A Way to Detect Bias by mannykannot on Sunday November 01, 2015 @11:46AM (#10486972)
Speculative explanations - i.e. assumptions - are not uncommonly offered in support of the proposition that there is no underlying bias. Nl provides a rare example of the assumptions being systematically investigated.
Re:A Way to Detect Bias by rewqfdsa on Saturday October 31, 2015 @07:55PM (#10484770)
Right, and unwillingness to consider the possibility of group differences comes from a quasi-religious devotion to the blank slate model of human nature. The way radical egalitarians see it, we're not only equal in dignity, but in potential.

That's a pretty view, but it's inconsistent with reality, and radical egalitarians need to come up with increasingly implausible explanations to explain everyday circumstances that make perfect sense once you drop the blank slate model.

Re:A Way to Detect Bias by baddox on Saturday October 31, 2015 @08:32PM (#10484886)
There is a simple explanation for differences in abilities between groups that has nothing to do with their genetics are so-called natural ability: the fact that groups often grow up around other members of their group. Both nature and nurture are largely in common for many groups, so it could easily be either that causes the observed differences in ability.
Re:A Way to Detect Bias by lexcorvus on Saturday October 31, 2015 @09:59PM (#10485109)
could easily be either

Or both. They're not mutually exclusive. Do Jamaican sprinters excel because they grow up around other sprinters or because they are blessed with natural ability? Yes. Simply put, or != xor.

Re:A Way to Detect Bias by lexcorvus on Saturday October 31, 2015 @10:01PM (#10485119)
Hey rewqfdsa, maybe shoot me an email some time. Address is in profile.
Re:A Way to Detect Bias by superuser2 on Saturday October 31, 2015 @08:18PM (#10484854)
Apply Occam's Razor to these supposed group differences. Which do you think is a more plausible reality?

A. Interviewers prefer candidates who are like themselves, interviewers are mostly white men, therefore most hires are white men.

B. The uterus and melanin both inhibit programming ability, interviewers are perfect judges of programming ability, therefore most hires are white men.

To look at the present (incomplete) evidence and decide that B is the more likely story, is racism/sexism.

Re:A Way to Detect Bias by devalier on Saturday October 31, 2015 @08:35PM (#10484892)
B. The uterus and melanin both inhibit programming ability, interviewers are perfect judges of programming ability, therefore most hires are white men.

Serious question: can you at least steel man this point of view rather than making it a ridiculous straw man? If you cannot steel man it, what makes you so sure you really understand the argument?

For bonus points, you can also point out the glaringly obvious complication to this chain of logic: A. Interviewers prefer candidates who are like themselves, interviewers are mostly white men, therefore most hires are white men.

Re:A Way to Detect Bias by rewqfdsa on Saturday October 31, 2015 @08:30PM (#10484882)
Which is more plausible?

a) the action of natural selection, sexual selection, and the hormone environment magically stop at the blood-brain barrier, or

b) there are real group differences between human populations?

We've already eliminated all overt discrimination. If you continue to cry discrimination, you're essentially postulating a giant unconscious conspiracy. I find the idea wildly implausible. It's much simple to just accept that not everyone is equal in aptitude and ability.

Re:A Way to Detect Bias by drumdance on Saturday October 31, 2015 @11:22PM (#10485297)
Women musicians started getting orchestra positions in much greater numbers after auditions were made blind.

If biases affect how a professional musician hears music, is it so shocking to think unconscious bias might affect someone's judgment a candidate based on multiple fuzzy factors like ability, culture, and personality?

And that's just for job applications. You really think the criminal justice system has removed unconscious bias?

Re:A Way to Detect Bias by WildUtah on Sunday November 01, 2015 @01:25AM (#10485530)
Criminal justice and orchestra employment are non-market phenomena. The people in charge do not benefit if the orchestra is great and are not accountable if innocents go to jail and murders spree freely and the tubas clank.

So of course the bosses pick out their friends and cronies. And a decent polity should restrain their corruption with blind auditions and accountable audits of prosecutions.

But investors should be looking for a good return on their money. They should be looking for the best investments they can find. If they're not, that is the source of bias right there.

Of course, the Wall Street industry is located in New York because you can use big city lights, strippers, and steaks to scam small town municipal pension fund managers who aren't investing their own money. Sand Hill Road is supposed to operate on different principles.

Re:A Way to Detect Bias by drumdance on Monday November 02, 2015 @04:22PM (#10495365)
The people in charge do not benefit if the orchestra is great

Have you ever actually worked for an orchestra? I have. The Chicago Symphony, Boston Symphony and other top orchestras take quality very seriously.

Do you think, say, Georg Solti or Daniel Barenboim were happy with "just pretty good" musicians? Their reputations (and fortunes, for top conductors are very well paid) depend on consistently outstanding performances.

And I don't know how you call it non-market. When you're income depends on millionaires donating vast sums of money, you damn well better care about quality.

It's like saying a football coach doesn't benefit if his team drafts the best players.

Re:A Way to Detect Bias by WildUtah on Monday November 02, 2015 @08:23PM (#10496728)
Re:A Way to Detect Bias by gammarator on Saturday October 31, 2015 @11:28PM (#10485304)
> you're essentially postulating a giant unconscious conspiracy

Let me introduce you to the extensive scientific literature on implicit bias: http://www.aas.org/cswa/unconsciousbias.html

Re:A Way to Detect Bias by rewqfdsa on Saturday October 31, 2015 @11:45PM (#10485340)
If the bias reflects a real Bayesian prior, it isn't the kind of bias that's unjust.
Re:A Way to Detect Bias by skj on Sunday November 01, 2015 @12:47AM (#10485446)
Not so. Priors/posteriors are only as good as the model they're based on. For instance, if you choose parental income as the feature it will can be a stronger signal than skin color, even though both may be good predictors. But the correlation between the income and skin color can account for the predictive power of one feature when the other features is the true cause.
Re:A Way to Detect Bias by WildUtah on Sunday November 01, 2015 @01:19AM (#10485513)
So if Americans from race A commit ten times more violent crime than others and the police consequently accuse and manhandle vast numbers of innocent Americans of race A, there's nothing unjust about that? The vast majority of citizens of race A are innocent of all offenses but deserve constant suspicion and low level official humiliation and violence in a just world for no reason other than being the same color as some crooks.

I don't agree.

Re:A Way to Detect Bias by lexcorvus on Sunday November 01, 2015 @06:42AM (#10486149)
accuse and manhandle vast numbers of innocent Americans of race A

One doesn't need to advocate accusing and manhandling to think the police should use statistically valid inferences in the name of justice. I myself am a member of a minority group—men—that is responsible for a vastly disproportionate share of crime, especially violent crime. You could mandate that cops ignore this reality and treat men and women with equal suspicion, but the result would be worse policing. For example, if you look at the statistics for New York's supposedly racist "stop-and-frisk" policy, you'll find that the disparity between whites and blacks is smaller than the disparity between men and women—indeed, smaller even than the disparity between white men and black women. Why have you never heard stop-and-frisk described as "sexist"?

This inconsistency is best explained politically: complaining about racial injustice against blacks is an effective route to power; complaining about gender injustice against men is not. It's the same reason you hear constant complaints about how white tech is, but not about how black sports are. Jesse Jackson can effectively shake down Apple and Intel [1], but there is no white equivalent shaking down the NFL. (Can you imagine if "increasing diversity in the NFL" meant "increasing the relative proportion of white players"? It would be a different world—not, incidentally, one I would particularly want to live in.)

Being male means people will infer based on a superficial assessment that I'm more likely to be a criminal than, say, my sister. But that inference is correct. Being a member of such a group is my lot in life, and complaining doesn't change what is.

[1]: See, e.g., http://www.mercurynews.com/census/ci_29048321/q-jesse-jackso...

Re:A Way to Detect Bias by lexcorvus on Saturday October 31, 2015 @09:30PM (#10485044)
A straightforward application of evolutionary biology to Homo sapiens yields group differences as the null hypothesis. You've done nothing but construct a ridiculous strawman to refute this. Moreover, discrimination and group differences aren't mutually exclusive—it's possible that Group X's underrepresentation in Field Y is the result of both discrimination and group differences. The only way to know for sure that it's pure discrimination is to show that group differences are negligible. This requires actually measuring them (which in fact has been done in exhausting detail [1]), but even suggesting the possibility of group differences frequently leads to accusations of racism and sexism—as you've just so ably demonstrated.

[1]: See, for example, The Blank Slate by Steven Pinker. Then, once you get over your knee-jerk "That's racist!!!" reflex, take a look—I mean actually read for comprehension—The Bell Curve by Herrnstein and Murray. Maybe add a little Cavalli-Sforza (via Steve Sailer) to the mix (http://www.vdare.com/articles/052400-cavalli-sforzas-ink-clo...). You can then graduate to basically anything by Arthur Jensen. As a topper, read "Rational"Wiki's entry on Human Biodiversity (http://rationalwiki.org/wiki/Human_biodiversity) and cringe at the smug, supercilious tone, endless strawmanning and distortion, and at the realization that you, too, were once taken in by the ridiculous "mainstream" views. (I certainly was.)

Re:A Way to Detect Bias by chei0aiV on Sunday November 01, 2015 @07:31AM (#10486222)
Thanks for literature and links. Hope I'll find the time to read this. The article from vdare.com seems really emotional to me. Not very reputable.

"Don`t believe any of this. It`s merely a politically-correct smoke screen that Cavalli-Sforza regularly pumps out to keep his life`s work — distinguishing the races of mankind and compiling their genealogies — from being defunded by the leftist mystagogues at Stanford."

"As you can imagine, this finding could get him in a bit of hot water if the campus thought police ever found out about it."

Re:A Way to Detect Bias by devalier on Sunday November 01, 2015 @12:04PM (#10487065)
This may be a better place to start -- https://jaymans.wordpress.com/jaymans-race-inheritance-and-i... and https://jaymans.wordpress.com/about/. VDare tends to preach and agitate to the already converted, that is the peril of having to survive on donations. That said, while Steve Sailer is snarky, he is also reputable. He takes good care to not get things wrong. I've been following him for a while, and when some bit of news comes out, or some new policy gets announced, and the NY Times says one thing, and Sailer says another, Sailer almost always ends up getting proved right.

If you want a book length treatment, Michael Hart's Understanding Human History is the complete opposite of the typical, Jared Diamond, environmentalist accounts of human society. It is worth perusing - https://lesacreduprintemps19.files.wordpress.com/2012/11/har...

Re:A Way to Detect Bias by lexcorvus on Tuesday November 03, 2015 @01:14AM (#10497898)
Understanding Human History is one of my favorite books. I finished it and immediately reread it. This was especially instructive given that a decade ago I read Jared Diamond's Guns, Germs, and Steel twice as well, quite innocent of the political subtext.
Re:A Way to Detect Bias by jonahx on Saturday October 31, 2015 @08:46PM (#10484920)
This is a smart insight, although in fairness the article suggests, in its female founder example, that there was discrimination against women -- that given men and women of equal ability, men were more likely to be chosen.

Condemning that inequality is different from affirming that selection should be altered to produce the outcomes people view as fair. One is saying, "Don't discriminate against Xs." The other is saying, "Not only can't you discriminate against them, you need to ensure that Xs have outcome Y. That is, you may be required to discriminate in their favor."

The latter is a value, and your point about mathematics being irrelevant stands. But the former is a mathematical claim, and pg was making a mathematical claim, so the mathematical argument you replied to is relevant.

Re:A Way to Detect Bias by Natsu on Saturday October 31, 2015 @10:14PM (#10485156)
I think the grandparent example is pointing out that it will be hard to use this for sexism claims precisely because studies have shown that the variance in ability in male and female populations is, in fact, different. The studies I'm aware of show more men at both extremes of the bell curve. So more men at the very top and bottom in IQ measurements[1].

There's a genetic basis for this, as well: women have two copies of each chromosome, whereas men have X and Y, so there's no second copy to take over in men, leading to more extreme outcomes, whether good or bad.

Now of course we ought to treat every group of people fairly, but we do need to examine our priors when doing so, especially when proposing ways to detect and punish people who may be thinking bad things, consciously or otherwise.

[1] We may not know just what 'IQ' is, but we do know that tests of mental ability all correlate with each other, suggesting an underlying factor. This, in turn, can be correlated with many other things, like success (or lack thereof).

Re:A Way to Detect Bias by 174676 on Saturday October 31, 2015 @11:19PM (#10485291)
Sorry but your reasoning does not let pg off the hook. In his article he says that the way to determine bias is by measuring the performance of those that got through. With your excuse, all you have to do is measure the number of people that got through in a particular group relative to the other group.
Re:A Way to Detect Bias by forrestthewoods on Saturday October 31, 2015 @10:01PM (#10485118)
But the stated objective of the root article was failed. It concluded that First Round Capital is biased against females. There is insufficient data to support that claim! It might actually be that FRC is biased FOR females. But the process leading up to FRC was so biased against females that females are still at a net loss.