Re:30% of Google's Emotions Dataset Is Mislabeled
by stingraycharles on Thursday July 14, 2022 @11:54AM
(#32097683)
I fully agree $20/hr is reasonable, it just was too expensive for us at that time.
So in the end the whole problem boils down to “quality is (more) expensive”; but MTurk is a special case since they’re so heavily positioning themselves as “the” solution for this and they’re terrible.
If you have more time than money it might not make sense, but at that price point I could save myself a lot of time by just working a few extra hours doing SE and let someone else do 3x that amount of labelling.