News for hackers. Stuff that matters.
Re:Spark Breaks Previous Large-Scale Sort Record by ch on Friday October 10, 2014 @03:09PM (#8439498)
Curious if using the Sparrow scheduler would have been a net gain/loss to this type of work load?
Re:Spark Breaks Previous Large-Scale Sort Record by rxin on Friday October 10, 2014 @03:33PM (#8439603)
It would help a little bit (maybe a few percent), but not much because the scheduling latency was relatively low for these tasks (the largest scheduling delay was ~10 secs, whereas each task takes minutes).