News for hackers. Stuff that matters.
Re:Baidu File System – A distributed file system for real-ti... by pkolaczk on Tuesday October 25, 2016 @05:06PM (#12791643)
HDFS biggest problem is its SPOF master-slave architecture, not JVM nor GC. With a truly distributed shared nothing system Java Gc would not be a problem, because servers can now run with no major Gc for hours or days. So two servers or clients doing Gc at the same time are very unlikely. And even if some of them do, the pauses from Gc are much more predictable than the pauses from I/O which on a loaded system can take seconds, not milliseconds.

Also if GC was such a huge problem, exchanges or HFT companies wouldn't use Java for their low latency stuff, and there definitely are companies which do.

Re:Baidu File System – A distributed file system for real-ti... by otterley on Tuesday October 25, 2016 @09:53PM (#12793311)
> Also if GC was such a huge problem, exchanges or HFT companies wouldn't use Java for their low latency stuff, and there definitely are companies which do.

Can you name one?

Re:Baidu File System – A distributed file system for real-ti... by pkolaczk on Wednesday October 26, 2016 @12:34AM (#12793904)
LMAX, New York Exchange.
Re:Baidu File System – A distributed file system for real-ti... by otterley on Wednesday October 26, 2016 @02:47AM (#12794406)
Wow, that's neat. Thanks for the pointer!