Re:Finding Kafka’s throughput limit in Dropbox infrastructure
by Twirrim on Friday February 01, 2019 @01:42PM
(#19057085)
I've worked on services running on java 8 getting high throughput with AES-NI, maxing out 10Gig interfaces. Java is rarely a problem there. Where it is, you can even JNI out to openssl for your AES-NI encryption needs and spare yourself a little CPU power (we discovered that JNI isn't as big a performance hit as people would have you believe)
[ Parent
| on HN ]
Re:Finding Kafka’s throughput limit in Dropbox infrastructure
by halbritt on Friday February 01, 2019 @05:38PM
(#19059462)
There's a JIRA issue that's been open for three years for kafka to support openssl with JNI:
https://issues.apache.org/jira/browse/KAFKA-2561
Not sure it's going to get done at this point. I've only recently started using kafka and found the TLS issues to be somewhat surprising. AES-NI has been around for how long now?
I speculate that this is because it's come out of the hadoop community and they haven't really had much luck implementing security features.
Re:Finding Kafka’s throughput limit in Dropbox infrastructure
by Twirrim on Saturday February 02, 2019 @12:23PM
(#19064231)
https://jaitechwriteups.blogspot.com/2017/10/kafka-with-open...
It looks like with Java 9 the SSL stuff in Kafka saw a drastic speed boost.