With 8 instances and the number of files the input was split in to there were definitely both map and reduce tasks waiting for a runner. I don't know exactly how much but I'm pretty sure I'm paying a pretty heavy IO tax by using S3.