Re:Feeding data to 1000 CPUs – comparison of S3, Google, Azu...
by rmcpherson on Tuesday January 05, 2016 @07:24PM
(#10847311)
That's true, although the latest stock ubuntu HVM AMIs (14+, I believe) have the SR-IOV driver already and use it by default. Older AMIs need to have it installed and enabled on the AMI. I believe enhanced networking is only available on HVM amis.
Re:Feeding data to 1000 CPUs – comparison of S3, Google, Azu...
by oavdeev on Tuesday January 05, 2016 @09:26PM
(#10848010)
This problem definitely existed with official 14.04 (HVM) AMI, though I haven't re-tested this recently, they may have fixed it. It did have some kind of SR-IOV driver but it was too old.
Re:Feeding data to 1000 CPUs – comparison of S3, Google, Azu...
by hrez on Tuesday January 05, 2016 @07:19PM
(#10847299)
Good point for "enchanced networking" instances.
I didn't see OS specified in the article.
AMZN linux would have SR-IOV driver by default.
PV vs HVM might also have an impact.
Re:Feeding data to 1000 CPUs – comparison of S3, Google, Azu...
by zbjornson on Tuesday January 05, 2016 @07:27PM
(#10847330)
Per the comment here [1] and the linked twitter convo, I'll retest S3 with Amazon Linux soon. These tests used Ubuntu 14.04 on all providers, and did use HVM. My understanding is that this will possibly increase the network throughput of the VM, but the benchmarks stayed below the VM's capacity (which was the reason I included the charts of VM throughput).
Re:Feeding data to 1000 CPUs – comparison of S3, Google, Azu...
by hiyer on Tuesday January 05, 2016 @09:33PM
(#10848034)
Couple of other points:
1. Enhanced Networking (SRIOV) only works in a VPC and not in EC2-Classic.
2. I think the 4x instances don't support 10Gb ethernet. If that is the case, it would also be instructive to test the 8x instances on S3.
For some very application (Hadoop) specific tests of Enhanced Networking, please take a look at https://www.qubole.com/blog/product/hadoop-enhanced-networki...
edit: Gbps not GBps