30% of Google's Emotions Dataset Is Mislabeled

Re:30% of Google's Emotions Dataset Is Mislabeled by CurleighBraces on Thursday July 14, 2022 @04:14AM (#32093381)

How about, "LETS F*ING GOOOOO YOU DINGBAT", now if that's a comment between friends the addition of the insult might be said in jest and still be impatient/enthusiastic, or does by adding the insult to the end automatically label it as combative?

I realise this wasn't part of the dataset, more making a point that written language without context ( and sometimes even with ) is subject to huge amounts of reader interpretation.

[ Parent | on HN ]

Re:30% of Google's Emotions Dataset Is Mislabeled by echen on Thursday July 14, 2022 @04:36AM (#32093538)

Agree that context is often needed! (Which is why it was strange to us that raters weren't presented with any context besides the comment text itself -- not even the subreddit, much less the original Reddit post.)

One interesting question, though: if "LETS FUCKING GOOOOO YOU DINGBAT" were meant to be a combative insult, would someone still add a bunch of O's ("GOOOOO" instead of merely "go")? My intuition is that if combativeness were intended, "let's fucking go, you dingbat" would be more likely than "LETS FUCKING GOOOOO YOU DINGBAT", but of course it's a bit hard to say without that context.

[ Parent | on HN ]

Re:30% of Google's Emotions Dataset Is Mislabeled by COMMENT___ on Thursday July 14, 2022 @04:21AM (#32093435)

This one is indeed hard to label.

PS Hope they will never begin solving philosophy problems with ML.

[ Parent | on HN ]