News for hackers. Stuff that matters.
Re:Time to regulate AI that interprets human emotions? by crazygringo on Wednesday April 07, 2021 @09:16PM (#26733902)
No, because the fundamental problem isn't the unreliability of detection by any single human.

The fundamental problem is that multiple emotions can result in the same facial expression, and the same emotion can result in multiple facial expressions.

It doesn't matter how many people label a face. It won't get over the fundamental issue that there is no 1-1 mapping between emotions and facial expressions.

Re:Time to regulate AI that interprets human emotions? by nl on Wednesday April 07, 2021 @10:16PM (#26734341)
> It won't get over the fundamental issue that there is no 1-1 mapping between emotions and facial expressions.

Actual experts disagree. For example Ekman, for the basic emotions at least (see the link I posted above). To quote:

In the late sixties, Izard and Ekman in separate studies each showed photographs from Tomkins’ own collection, to people in various literate cultures, Western and Non-Western. They found strong cross-cultural agreement in the labeling of those expressions. Ekman closed the loophole that observing mass media might account for cross cultural agreement by studying people in a Stone Age culture in New Guinea who had seen few if any outsiders and no media portrayals of emotion. These preliterate people also recognized the same emotions when shown the Darwin-Tomkins set. The capacity for humans in radically different cultures to label facial expressions with terms from a list of emotion terms has replicated nearly 200 hundred times.[1]

The FACS coding system[2] has pretty good experimental support, across multiple cultures. As noted on this article, it can distinguish between fake smiles and real smiles etc. See https://en.wikipedia.org/wiki/Smile#Duchenne_smile for more on this.

Even if you disagree with that and think that motion is required (which is an argument that has some validity) there is still no reason to think a computer system can't do it.

[1] https://www.paulekman.com/blog/darwins-claim-universals-faci...

[2] https://en.wikipedia.org/wiki/Facial_Action_Coding_System

Re:Time to regulate AI that interprets human emotions? by crazygringo on Thursday April 08, 2021 @02:40PM (#26742227)
Actual experts today disagree with Paul Ekman -- the book I linked to in my root comment provides an extensive discussion of this.

Ekman was at the forefront of creating facial emotions expression research, but while I do believe he convincingly showed that there are basic instinctual, stereotypical, cross-cultural facial expressions, the field now generally accepts that FACS coding does not map reliably to emotions in real-life contexts.

In other words, just because a smile is a cross-cultural instinctual display of happiness does not mean a given individual who is happy will be smiling, or that a given individual who is smiling will be happy.

Re:Time to regulate AI that interprets human emotions? by PeterisP on Wednesday April 07, 2021 @10:10PM (#26734303)
A 1-1 mapping isn't required, IMHO everybody involved would consider a probability distribution as a reasonable expected output, and as long as that probability distribution is reasonably close to reality and is substantially different from the prior, output like that is useful signal and would count as the system working.

The same applies for labeling, if a particular facial expression can occur in an indistinguishable manner because of three different causes, that's okay; there's nothing wrong with a gold standard label in training data marked as "we've observed that 50% people had this expression because they were angry and 30% because they were in pain, but no happy or sleepy people had an expression like that".

Furthermore, for the purpose listed in the article, you don't need to determine an absolute value of some emotional state, but you need to detect large shifts in it (i.e. you get an baseline that implicitly adjusts for part of individual and cultural differences) - i.e. whether the audience (in aggregate!) now looks significantly more frustrated than the same people looked 30 minutes ago.