Re:Spark as a Compiler: Joining a Billion Rows per Second on...
by scottlocklin on Tuesday May 24, 2016 @02:12AM
(#11759295)
You obviously have no idea what you're talking about. You can do all of this in Kx systems as well, and it runs a lot faster than spark.
I beat a databricks stack (hand tuned by one of the authors of big-DF) running on a large cluster using one jd node by factors of "a lot." And K is faster than J.
I beat a databricks stack (hand tuned by one of the authors of big-DF) running on a large cluster using one jd node by factors of "a lot." And K is faster than J.