News for hackers. Stuff that matters.
Re:Spark Breaks Previous Large-Scale Sort Record by chad_walters on Friday October 10, 2014 @01:41PM (#8439057)
Your post mentions "single root IO virtualization" as a factor in maximizing network performance. I am wondering what the impact of this was in your sorting. Do you have data for runs where you didn't enable this?
Re:Spark Breaks Previous Large-Scale Sort Record by rxin on Friday October 10, 2014 @02:05PM (#8439182)
It was part of the enhanced networking. Without enhanced networking, we were getting about 600MB/s, vs 1.1GB/s with.