Re:Apache Kafka – Publish-subscribe messaging rethought as a...
by jorgeortiz85 on Wednesday March 12, 2014 @05:29PM
(#7388537)
Kafka uses Linux's zero-copy transfer to move bytes between the network and the disk without going through user-space, let alone the JVM.
There's still GC from objects allocated by Kafka in the JVM, but the actual message data doesn't even go through the JVM.
Re:Apache Kafka – Publish-subscribe messaging rethought as a...
by kasey_junk on Wednesday March 12, 2014 @03:10PM
(#7387599)
The standard way to do this is to go off heap using the Unsafe packages. Essentially you start handling your own memory, with all that entails.
With Java, you don't have the unmanaged or struct support, so doesn't that really add up? If you go "native", isn't there significant overhead since you can't have pointers in Java (right - the bytecode doesn't support it?)?
People pull it off, but it seems that GC overhead would be a killer.