News for hackers. Stuff that matters.
Re:Time to regulate AI that interprets human emotions? by crazygringo on Wednesday April 07, 2021 @12:42PM (#26727397)
First, you need reliable training data to begin with. This can't be supplied by third-party labeling of faces, so it would need to be done with a dataset of self-reported emotions, but self-reported emotions also have tons of pitfalls well documented in the literature.

But second, the correlations of individual facial muscle contractions with emotions has been extensively studied and it's far noisier, inconsistent, or completely devoid of a signal than many people assume. In academic terms there's no such thing as a reliable emotional "signature" to be gleaned from facial muscle activation.

So the point is, it appears that the raw data simply isn't there for the AI to detect patterns that humans can't. Detecting emotions requires far more data points outside of facial muscle activation -- such as the ones I listed.

Re:Time to regulate AI that interprets human emotions? by nl on Wednesday April 07, 2021 @07:44PM (#26733115)
> This can't be supplied by third-party labeling of faces

Yes it can. You get enough labelling and it overcomes the unreliability of detection by any single human.

Get 70 people to label the same face. A random distribution over the 7 Ekman emotions[1] will give 10 each, and any non-random variation from that is a signal. Do that over enough faces and you'll get something to train on.

(Also, no reason why it needs to be face pictures. It could be 2 second video snippets for example).

[1] https://www.paulekman.com/blog/darwins-claim-universals-faci...

Re:Time to regulate AI that interprets human emotions? by crazygringo on Wednesday April 07, 2021 @09:16PM (#26733902)
No, because the fundamental problem isn't the unreliability of detection by any single human.

The fundamental problem is that multiple emotions can result in the same facial expression, and the same emotion can result in multiple facial expressions.

It doesn't matter how many people label a face. It won't get over the fundamental issue that there is no 1-1 mapping between emotions and facial expressions.

Re:Time to regulate AI that interprets human emotions? by nl on Wednesday April 07, 2021 @10:16PM (#26734341)
> It won't get over the fundamental issue that there is no 1-1 mapping between emotions and facial expressions.

Actual experts disagree. For example Ekman, for the basic emotions at least (see the link I posted above). To quote:

In the late sixties, Izard and Ekman in separate studies each showed photographs from Tomkins’ own collection, to people in various literate cultures, Western and Non-Western. They found strong cross-cultural agreement in the labeling of those expressions. Ekman closed the loophole that observing mass media might account for cross cultural agreement by studying people in a Stone Age culture in New Guinea who had seen few if any outsiders and no media portrayals of emotion. These preliterate people also recognized the same emotions when shown the Darwin-Tomkins set. The capacity for humans in radically different cultures to label facial expressions with terms from a list of emotion terms has replicated nearly 200 hundred times.[1]

The FACS coding system[2] has pretty good experimental support, across multiple cultures. As noted on this article, it can distinguish between fake smiles and real smiles etc. See https://en.wikipedia.org/wiki/Smile#Duchenne_smile for more on this.

Even if you disagree with that and think that motion is required (which is an argument that has some validity) there is still no reason to think a computer system can't do it.

[1] https://www.paulekman.com/blog/darwins-claim-universals-faci...

[2] https://en.wikipedia.org/wiki/Facial_Action_Coding_System

Re:Time to regulate AI that interprets human emotions? by crazygringo on Thursday April 08, 2021 @02:40PM (#26742227)
Actual experts today disagree with Paul Ekman -- the book I linked to in my root comment provides an extensive discussion of this.

Ekman was at the forefront of creating facial emotions expression research, but while I do believe he convincingly showed that there are basic instinctual, stereotypical, cross-cultural facial expressions, the field now generally accepts that FACS coding does not map reliably to emotions in real-life contexts.

In other words, just because a smile is a cross-cultural instinctual display of happiness does not mean a given individual who is happy will be smiling, or that a given individual who is smiling will be happy.

Re:Time to regulate AI that interprets human emotions? by PeterisP on Wednesday April 07, 2021 @10:10PM (#26734303)
A 1-1 mapping isn't required, IMHO everybody involved would consider a probability distribution as a reasonable expected output, and as long as that probability distribution is reasonably close to reality and is substantially different from the prior, output like that is useful signal and would count as the system working.

The same applies for labeling, if a particular facial expression can occur in an indistinguishable manner because of three different causes, that's okay; there's nothing wrong with a gold standard label in training data marked as "we've observed that 50% people had this expression because they were angry and 30% because they were in pain, but no happy or sleepy people had an expression like that".

Furthermore, for the purpose listed in the article, you don't need to determine an absolute value of some emotional state, but you need to detect large shifts in it (i.e. you get an baseline that implicitly adjusts for part of individual and cultural differences) - i.e. whether the audience (in aggregate!) now looks significantly more frustrated than the same people looked 30 minutes ago.

Re:Time to regulate AI that interprets human emotions? by visarga on Wednesday April 07, 2021 @03:32PM (#26729913)
Unsupervised learning is really good today, about 1-2% under supervised learning. You can also cross correlate text, audio and video. If there's signal in the data, then a model can learn it, and you don't need so many labels.
Re:Time to regulate AI that interprets human emotions? by wizzwizz4 on Wednesday April 07, 2021 @03:59PM (#26730339)
The signal is facial expressions. You're missing the “map facial expressions to emotions” step.
Re:Time to regulate AI that interprets human emotions? by unishark on Wednesday April 07, 2021 @04:13PM (#26730533)
Your argument is basically that since something is hard it is impossible?
Re:Time to regulate AI that interprets human emotions? by crazygringo on Wednesday April 07, 2021 @09:24PM (#26733974)
No, my argument is that if something is impossible it's impossible. I said "the raw data isn't there", not that "the raw data is hard to interpret".
Re:Time to regulate AI that interprets human emotions? by neolog on Wednesday April 07, 2021 @05:35PM (#26731668)
> self-reported emotions also have tons of pitfalls well documented in the literature

That's interesting. Where can I read about these issues?