MTurk sucks. I need to have over a thousand video transcripts manually fixed, and so far, only about 15% come back even close. Most MTurkers submit the original, unmodified transcript, or something completely irrelevant. I have to use diffing software just to quickly scan each submission for scammers trying to make a quick buck. Granted, I feel like a scammer myself for paying so little (but the decision for payout is coming from above me).