News for hackers. Stuff that matters.
Re:IBM no longer offers general purpose facial recognition o... by formercoder on Monday June 08, 2020 @10:03PM (#23462907)
There are real technical challenges here. Lighter skin has more contrast between light and dark.
Re:IBM no longer offers general purpose facial recognition o... by aeturnum on Monday June 08, 2020 @11:27PM (#23463376)
There are real technical challenges in producing photographs of both light and dark skin, but the focus on light skinned subjects have led to an accumulation of technical solutions.

Computerized facial recognition has been progressing for something like 50 years, with each paper building on previous work. I suspect a parallel world where the dominant social group hard dark skin would explore different technical avenues, focus on ways of recognizing faces that lean less on tone, etc. Obviously it's hard to say with what we know now.

Humans have difficulty recognizing cross-ethnic faces, however I don't think dark skinned people are worse at recognizing same-ethnic faces than light skinned people. To me that suggests our social history is more to blame than some fundimental quality of skin tone.

Re:IBM no longer offers general purpose facial recognition o... by pfranz on Tuesday June 09, 2020 @12:22AM (#23463623)
It goes even deeper than that. If you look at the history of photography, film, and television you'll see a bias towards white skin tones that standards have been built up around. Just looking at "leader ladies" or common reference images there isn't a bunch of diversity. In practice I've heard cinematographers and photographers bring it up around filming different ethnicities. It starts with changing the exposure, but means you have to spend more attention towards color reproduction.

This can extend beyond the film or image sensor to biasing lighting equipment, defaults, standards, and thresholds.

Looking through the literature you'll see things like, "the design decisions in the NTSC’s test images effectively biased the format toward rendering white people as more lifelike than other races"

https://sterneworks.org/Mulvin-Sterne-Scenes.pdf

I'm mostly familiar with the history in the US. I'm earnestly curious about how other countries accommodated these types of things as they adopted the technologies.

Re:IBM no longer offers general purpose facial recognition o... by dnautics on Tuesday June 09, 2020 @02:25AM (#23464247)
It's deeper than that. The chemicals used in analog color photography didn't have a dye profile that could capture people of color effectively until the 80s.
Re:IBM no longer offers general purpose facial recognition o... by sangnoir on Tuesday June 09, 2020 @03:10AM (#23464452)
Even deeper- Kodak only started putting effort to get the process right in the 70s after customers complained about poor color reproduction[1] in wood grain and chocolate

1. https://petapixel.com/2015/09/19/heres-a-look-at-how-color-f...

Re:IBM no longer offers general purpose facial recognition o... by lallysingh on Tuesday June 09, 2020 @02:37AM (#23464302)
I'm guessing that nobody cared to try.
Re:IBM no longer offers general purpose facial recognition o... by solarkraft on Tuesday June 09, 2020 @03:12AM (#23464458)
I suspect it to be deeper than that: The relevant people didn't think it was worth it to invest all that much into developing it.
Re:IBM no longer offers general purpose facial recognition o... by gugagore on Monday June 08, 2020 @10:19PM (#23462993)
Worth noting that sometimes technical challenges may arise because of the way technology was designed as opposed to being inherently challenging

https://www.npr.org/2014/11/13/363517842/for-decades-kodak-s...

but, yes, dark skin reflects less light than light skin. by definition.

Re:IBM no longer offers general purpose facial recognition o... by chillacy on Monday June 08, 2020 @11:18PM (#23463319)
I recall being amused maybe 3 years ago when I took a picture of two friends, one with dark skin, one with light skin, and the camera choose to expose for the darker skin. He looked fine, the lighter skin friend looked like snow lit by headlights. Completely washed out.

The camera settings and background lighting make a big difference.

Re:IBM no longer offers general purpose facial recognition o... by redis_mlc on Tuesday June 09, 2020 @01:39AM (#23463986)
FYI: Wedding photographers deal with the contrast between white dresses and black suits/tuxedos every day, for the last century.

Some notes:

- the eye can handle the dynamic range, but there's no correct exposure for that photographic combination, so they play with lighting, exposure bracketing and dodging when printing

- it's recommended that brides wear off-white (like cream) or other colors of fabric if they're concerned about the photos

Re:IBM no longer offers general purpose facial recognition o... by Polylactic_acid on Tuesday June 09, 2020 @03:03AM (#23464413)
Isn't the solution to this to take 2 photos and merge them later?
Re:IBM no longer offers general purpose facial recognition o... by btgeekboy on Tuesday June 09, 2020 @03:57AM (#23464676)
A RAW photo (raw input from the camera sensor, without processing) can often be used in post production to get more range out of a photo than would be possible with a JPEG. One of my desktop backgrounds I often use was actually quite overexposed due to the sun shining through trees. I was able to correct for it in Lightroom and it's now one of my favorite shots.
Re:IBM no longer offers general purpose facial recognition o... by donatzsky on Tuesday June 09, 2020 @03:54AM (#23464663)
That's exactly what (exposure) bracketing is for. You take three photos at different exposures and merge them. This is also how a lot of HDR photography is done.
Re:IBM no longer offers general purpose facial recognition o... by gsich on Tuesday June 09, 2020 @03:37AM (#23464592)
If nobody moves - go for it.
Re:IBM no longer offers general purpose facial recognition o... by redis_mlc on Tuesday June 09, 2020 @04:10AM (#23464734)
That's one way, but a lot of work for more than one photo. Going from setting adjustment to photoshopping is a huge step-up up in terms of labor and cost.
Re:IBM no longer offers general purpose facial recognition o... by omnibrain on Tuesday June 09, 2020 @05:04AM (#23464993)
And that is why you pay a wedding photographer instead of just asking uncle Herbert to take some pretty pictures with his DSLR.

Mind you, the hobbyist uncle may produce great photos an may be a wizard with lightroom and photo shop. But a lot of hobbyists try to compensate with gear for skill, or more charitable may not be even aware of related skills an possibilities. So in the end the snapshots your friend Andy took with his 2 year old iPhone might look better (have better automatic processing) than those photos Herbert took with his expensive prosumer or even pro kit.

Re:IBM no longer offers general purpose facial recognition o... by dingaling on Tuesday June 09, 2020 @01:33AM (#23463951)
Which is why photographers ignore autoexposure and instead meter on a known reference such as an 18% grey card, or green grass.
Re:IBM no longer offers general purpose facial recognition o... by WorldMaker on Tuesday June 09, 2020 @03:58PM (#23470236)
I learned that one convention group I'm a part of converged on very visible glossy white badge cards not just because it is easy to sharpie names visibly on (in classic "Hello my name is" style), but also out of a request from the photography group as it is a very useful meter reference visible in almost every photo of any group member.

Seeing how many great photos come out of the event in sometimes very strange lighting conditions (as you might expect from an event that includes everything from brightly lit outdoors events to indoor conference spaces and theaters to rock show-lit concerts, and everything in between), I'd imagine that little metering trick is doing wonders.

Re:IBM no longer offers general purpose facial recognition o... by chillacy on Tuesday June 09, 2020 @12:25PM (#23468014)
Oh just thought of another example: bodybuilders apply heavy tan to look darker on stage. It helps muscles show better under heavy stage lighting.

https://www.quora.com/Why-are-all-bodybuilders-tan-Do-they-u...

Re:IBM no longer offers general purpose facial recognition o... by andromeduck on Tuesday June 09, 2020 @01:17AM (#23463878)
Was this on a DSLR/MILC? My Sony seems to do this sometimes when I have a very dark and very light subject outside but it's usually fine in RAW.
Re:IBM no longer offers general purpose facial recognition o... by mschuster91 on Tuesday June 09, 2020 @04:02AM (#23464694)
On my A7S2 I simply use the exposure correction wheel in such situations - or use the exposure series function so I can mess around with HDR later in Photoshop.
Re:IBM no longer offers general purpose facial recognition o... by andromeduck on Wednesday June 10, 2020 @01:43PM (#23479889)
Yeah I usually just use exposure comp too, it works pretty well most of the time but candids when everyone's moving and the background is changing can be pretty hard without a fill flash to help out a bit. Thank god for iso invariance though.
Re:IBM no longer offers general purpose facial recognition o... by centimeter on Monday June 08, 2020 @11:12PM (#23463268)
White people also have higher facial variance in general. I vaguely remember in university we had an assignment to generate “eigenfaces” or something and if you partitioned the faces by race the output of the SVD would be much wider for white people. This isn’t especially surprising when you consider the fact that white people have more light/dark contrast, more hair colors, more eye colors, etc. I think a lot of the “bias” complaints levied against algorithms like this are not bias at all, but just humans who are unhappy the world doesn’t quite live up to their idealized model.
Re:IBM no longer offers general purpose facial recognition o... by rockarage on Monday June 08, 2020 @11:45PM (#23463452)
When you sample from a smaller pool you will make uninformed statements like this. Black/Dark people of the world are not limited to Black people in Atlanta. Bet many people here do not know that there are Black people in this world, some who have naturally blonde hair and some who have blue eyes, google it.

Moreover capturing Black/Dark skin and features requires more accurate light metering & lighting because dark skin absorb more light. There's a lot variance in cheekbones, nose and lips.

Humans' features in general, are more complicated then you realize.

Re:IBM no longer offers general purpose facial recognition o... by throwaway391003 on Tuesday June 09, 2020 @12:06AM (#23463534)
Ok but that can still be true (blonde hair, blue eyes) while there still being much more variations in the white population than in the black population.

I'm curious how many white people there are on earth vs how many black people there are, and other races. A couple google searches didn't give me any easy finds

Re:IBM no longer offers general purpose facial recognition o... by Impossible on Tuesday June 09, 2020 @12:38AM (#23463698)
Black people can have blond hair and blue eyes also. Common in Melanesians but not unheard of in African Americans either. I had blonde hair when I was a baby and genetically I'm 83% African (average admixture across all Black Americans). An uncle of mine had blue eyes when he was born
Re:IBM no longer offers general purpose facial recognition o... by claudeganon on Tuesday June 09, 2020 @12:33AM (#23463675)
That’s because “white” and “black” are loose, shifting, ideological constructions with little basis in the scientific reality of human genetic variation. Many “white people” weren’t considered “white” until fairly recently and Africa actually has more human genetic variation than anywhere else.
Re:IBM no longer offers general purpose facial recognition o... by cycomanic on Tuesday June 09, 2020 @12:44AM (#23463726)
I always cringe when reading about "race" in the US, the term really (intentionally? ) gives the impression that there is a clear genetic demarcation between people based on skin color.

The US is the only country I am aware of who still uses this term, everywhere else was using some thinking like ethnicity to indicate different culture, origin...

Re:IBM no longer offers general purpose facial recognition o... by lowdose on Tuesday June 09, 2020 @08:19AM (#23465963)
The UN pushed from the 1950 to replace race with culture. Many people around the world now say "But he is from a different culture." Instead of "But he is from a different race."

https://www.tandfonline.com/doi/abs/10.1080/0031322050034783...

Re:IBM no longer offers general purpose facial recognition o... by centimeter on Tuesday June 09, 2020 @12:14PM (#23467894)
> little basis in the scientific reality of human genetic variation

This meme dates back to a loose claim made by R. Lewontin back in the 70s. In fact, you can very precisely and reliably recreate the "intuitive" human racial categorization using unsupervised algorithms, like doing multi-dimensional clustering over fixation indices. (It does not work using single-dimensional clustering, which is what Lewontin was talking about.)

Modern biologists usually talk in terms of clines rather than races, but this is just using the first derivative instead of the zeroth - you'll get the same result either way.

> Africa actually has more human genetic variation than anywhere else.

SNP diversity has ~nothing to do with phenotypic variance.

Re:IBM no longer offers general purpose facial recognition o... by claudeganon on Tuesday June 09, 2020 @01:01PM (#23468381)
Of course the question here is recreate whose “intuitive racial categorization” because all of that is historically and culturally specific. Saying it’s possible for a computer to recreate these categorizations presumes that the categorization has some objective reality outside of this when they’re just a variable heuristic determined by all those inputs.
Re:IBM no longer offers general purpose facial recognition o... by centimeter on Tuesday June 09, 2020 @01:30PM (#23468733)
> all of that is historically and culturally specific

Not really - almost everyone can agree on "middle eastern/north african", "east asian", "south asian", "black african", "white", etc. If you force people to pick a single-digit number of major categories, they're probably going to come up with the same categories that k-means in fixation space would.

Re:IBM no longer offers general purpose facial recognition o... by claudeganon on Tuesday June 09, 2020 @04:28PM (#23470542)
This is an evidence-free supposition, consistent with your pattern across this thread of making broad claims without anything to support them. You’ve provided no proof that k-means on a representative sample of phenotypic variation in the groups you cite would return this result.

That almost everyone can agree on these categories is also contrary to reality. For example, many of who you describe as East Asians consider themselves racially distinct both within their societies and from their nearby neighbors. Also, what major categories do mixed race people fall inside?

Re:IBM no longer offers general purpose facial recognition o... by centimeter on Tuesday June 09, 2020 @06:51PM (#23471842)
It's not my job to provide detailed proof on every HN post I make; I'm just pointing out something relevant, and if it interests you, you can go ahead and find where people have already done this. I think I've been specific enough that you can find this stuff on your own. This took me about 1 minute to find: https://www.discovermagazine.com/health/to-classify-humanity...

> many of who you describe as East Asians consider themselves racially distinct

That's why I specifically mentioned the number of racial categories involved. Obviously as the number increases you can have different clustering results.

> Also, what major categories do mixed race people fall inside?

Obviously not into any of them, if we're talking about a simple mechanical classifier with high separation.

Re:IBM no longer offers general purpose facial recognition o... by claudeganon on Tuesday June 09, 2020 @07:37PM (#23472195)
The number of racial categories would itself be an arbitrary limit not corresponding to actual genetic variance, nor would classification under such limit capture said variance, and none of it would match up to the folk biology of racial categorization. This is the general problem with reasoning backwards from 19th century gobbledygook about human genetic variation instead of beginning with the genetics themselves.

It may not be “your job” to provide such evidence, but you’ve made a series of specific claims about things like the rate of phenotypic variance among different racial groups. If you don’t want to defend them, that’s your prerogative, but you also can’t expect them to be received as authoritative or remain free of challenge.

Re:IBM no longer offers general purpose facial recognition o... by user982 on Tuesday June 09, 2020 @12:25AM (#23463633)
> Ok but that can still be true (blonde hair, blue eyes) while there still being much more variations in the white population than in the black population.

Even the man who coined "Caucasian" as a racial category recognized that there was more physical variance among African populations and individuals than compared with Europeans.

Re:IBM no longer offers general purpose facial recognition o... by Gibbon1 on Tuesday June 09, 2020 @01:54AM (#23464073)
I think there is by far more mitochondrial DNA variations inside Africa than outside.
Re:IBM no longer offers general purpose facial recognition o... by centimeter on Tuesday June 09, 2020 @12:06PM (#23467830)
You've made the one good point that I've seen in these responses, which is that I think all the pictures were sourced from the US. If black Americans are descended from a relatively narrow geographic region in Africa, that could lead to me underestimating phenotypic variance for black people in general. However, the problem would still exist when the technology is deployed in America.

> some who have naturally blonde hair and some who have blue eyes

I know they exist, but we are talking about statistical properties of entire populations, and these people are very rare.

> Humans' features in general, are more complicated then you realize.

It's not about what I realize - it's about what can be mechanically detected.

Re:IBM no longer offers general purpose facial recognition o... by rockarage on Tuesday June 09, 2020 @05:42PM (#23471230)
What can be mechanically detected is limited to how the data is collected.

You missed this part: "Moreover capturing Black/Dark skin and features require more accurate light metering & lighting because dark skin absorbs more light."

I have to see the images used to train the ML model, to be certain, but based on my experience working in photography and programming, I believe it is more likely than not that they used essentially poor quality images for the training.

Moreover, after the model has been trained, to use the system effectively the facial recognition camera has to be set up to capture both light and dark skin, in the case of dark skin, it typically means not relying on available light alone indoors, an additional camera light must be provided.

The reality is if you want a facial recognition system that accurately detects dark skin it will cost a bit more to do it right.

Re:IBM no longer offers general purpose facial recognition o... by bryanrasmussen on Tuesday June 09, 2020 @01:02AM (#23463805)
White people have more facial variance than all the people categorized as not White people? That seems unlikely.

But if it were so, then it sort of invalidates your argument because the bias complaints are that the facial recognition algorithms often misidentifies other races (not generally as white but as perhaps not human)

Specifically the scandal some years ago when black people where being identified as gorillas, it seems obvious to me that if non-white people have less facial variance it should be easier to identify black people as black instead of more difficult.

Re:IBM no longer offers general purpose facial recognition o... by gvjddbnvdrbv on Tuesday June 09, 2020 @02:25AM (#23464250)
Some massive majority of human genetic diversity is in Africans alone. I doubt faces don't reflect this.
Re:IBM no longer offers general purpose facial recognition o... by nutanc on Tuesday June 09, 2020 @12:05AM (#23463531)
Did you just say "All y'all look alike!" to non white people?
Re:IBM no longer offers general purpose facial recognition o... by UnFleshedOne on Tuesday June 09, 2020 @01:08AM (#23463832)
Is that a bad thing to say now? O_o

I thought it was a basic understanding that unfamiliar people, events, places, etc _do_ look alike, because before you get sufficient experience and exposure, you don't have enough skill to know what features are important to focus on and which ones carry no information.

Re:IBM no longer offers general purpose facial recognition o... by Polylactic_acid on Tuesday June 09, 2020 @03:08AM (#23464444)
Its a well known thing that people have a harder time telling the difference but I have not seen it mentioned that software would. For example zebras are all uniquely identifiable by their stripes and other zebra and computers could identify them but I would have no hope.
Re:IBM no longer offers general purpose facial recognition o... by andrewaylett on Tuesday June 09, 2020 @10:38AM (#23467028)
It's true. But that doesn't mean we shouldn't put the effort in to learn, and especially put the effort into our software.

It's also worth considering what saying that implies to the people you're saying it to. Especially when said dismissively. I'm terrible at names, faces, voices, pretty much any way of telling people apart. But that's my problem, and I need to be careful not to push the burden of that problem onto the people around me.

Re:IBM no longer offers general purpose facial recognition o... by kennywinker on Tuesday June 09, 2020 @10:43AM (#23467065)
If you say “i have trouble telling people of ___ race apart” that’s different from “you all look the same”. One is a statement of your own limitations, the other is saying your own limitation is actually someone else’s fault.

The first one CAN also be troubling if you have had ample exposure to become familiar, and are indirectly admitting that you did not believe it to be an important skill to learn.

Re:IBM no longer offers general purpose facial recognition o... by snug on Tuesday June 09, 2020 @01:39PM (#23468832)
Lots of white people also look the same, I grew up in a mostly Mexican environment, living in the Bay Area now, I find it difficult to recognize lots of white people apart from each other.

I'd say it's an ignorant thing to say in the way you say it. Like you said in this post, you just don't know the features to look out for when you're not familiar with them

Re:IBM no longer offers general purpose facial recognition o... by KarlKemp on Tuesday June 09, 2020 @01:37AM (#23463965)
No, software people never do anything this controversial. They were just observing that they know of a universal law of nature as described in a recent Quillete article, and/or have second-hand knowledge of a particular quirk of a specific software that is definitely not just the reflection of its creators' myopic world-view.
Re:IBM no longer offers general purpose facial recognition o... by mattkrause on Tuesday June 09, 2020 @01:34AM (#23463957)
Do you have a reference for this?

You might be right in terms of hair or eye color (not too many gingers outside Europe), but Africa has a vast amount of genetic diversity, so I'd naively guess that variance along other feature dimensions would be correspondingly higher too.

Re:IBM no longer offers general purpose facial recognition o... by TuringNYC on Tuesday June 09, 2020 @01:28AM (#23463922)
If there are technical challenges which would produced bias results...perhaps the answer is to not release the product. Perhaps do more R&D or more training on broader samples until one has a better product to release?
Re:IBM no longer offers general purpose facial recognition o... by xupybd on Tuesday June 09, 2020 @01:48AM (#23464043)
I don't think they are releasing products to make the world a better place. After all this tech is very dangerous. I don't the the ethics of racial bias are factored in to the decision making at these companies.

This is one bias I think benefits folks with dark skin. I'd love to be in the group that doesn't get recognised by this terrifying tech.

Re:IBM no longer offers general purpose facial recognition o... by mwcampbell on Tuesday June 09, 2020 @12:05AM (#23463530)
But does the reason matter when the result is discrimination against people through no fault of their own?
Re:IBM no longer offers general purpose facial recognition o... by raxxorrax on Tuesday June 09, 2020 @01:30AM (#23463928)
Please discriminate against me too if that means facial recognition isn't working.
Re:IBM no longer offers general purpose facial recognition o... by krisoft on Tuesday June 09, 2020 @02:59AM (#23464387)
That’s not necessarily what you want. “not working” can manifest itself in false positive matches too. Cue “all X people look the same” stupidness.

And the truth is, the danger zone is when the algo is somewhat ok, but a few percents worse on the discriminated group. If it were obviously stupidly bad (like for example any two black people are a positive match according to it) then people will disregard it. But if its just slightly bad thats harder to notice and suddenly your loan/car rental is rejected because the security system says you look too much like a specific known fraudster. And of course they wont even tell you that thats the reason, because security.

Re:IBM no longer offers general purpose facial recognition o... by raxxorrax on Tuesday June 09, 2020 @06:42AM (#23465404)
I worked in imaging for medical diagnostic support and dark complexions are just plainly more difficult to analyse because of restricted illumination times and limited contrast. Sensors got much better in recent years though.

The indications in question were extremely rare for black people on the other hand. Another use case was the detection of Vitiligo, which is significantly more easy on black people. There was a great demand for therapies because patients are stigmatized for different reasons, especially in Africa because the symptoms can look similar to some deadly diseases.

There is a lot of discrimination in imaging, but it doesn't have to do with race and more with the creation of binary images.

As for facial recognition. I see some use cases for convenience, but it would be far more effective to disallow widespread application because of the numerous unsolved problems. So I see the move from IBM positively, even if they continue their work. In the end I believe face reg to be possible without bias, but I don't have these propped up security needs.

Re:IBM no longer offers general purpose facial recognition o... by lvh on Tuesday June 09, 2020 @11:37AM (#23467544)
"Doesn't work" doesn't just mean it won't identify you. It can also mean it _falsely_ identifies you, because it's bad at identifying you.

If your a member of Congress who is also a person of color, it will do that at twice the rate of your white colleagues. [0]

[0]: https://www.aclu.org/blog/privacy-technology/surveillance-te...

Re:IBM no longer offers general purpose facial recognition o... by ponker on Monday June 08, 2020 @10:39PM (#23463095)
But the fact that the technology is considered viable given this failure mode is what reflects the bias. If a vendor has tech that can only distinguish white faces it will sell it as “detect your best customers and offer them special deals when they enter your store.” If the tech can only recognize black faces it will be sold as “recognize known criminals in the neighborhood and alert police when they enter your store.”
Re:IBM no longer offers general purpose facial recognition o... by nostromo on Monday June 08, 2020 @10:42PM (#23463110)
I'd like to know what cartoon villain tech company you're referring to...