Re:30% of Google's Emotions Dataset Is Mislabeled
by maest on Thursday July 14, 2022 @04:41AM
(#32093568)
> I wonder how others do this kind of thing.
We did the exact same for a text classification project.
The multi-week grind was awful, but it meant 1. we had a really good understanding of our data 2. we discovered surprising edge cases that we would have missed otherwise.
There is a very large fixed overhead you need to pay when you start outsourcing that work, so doing it yourself is cheaper at scales beyond what you'd normally expect.
We did the exact same for a text classification project.
The multi-week grind was awful, but it meant 1. we had a really good understanding of our data 2. we discovered surprising edge cases that we would have missed otherwise.
There is a very large fixed overhead you need to pay when you start outsourcing that work, so doing it yourself is cheaper at scales beyond what you'd normally expect.