Re:Blaze: Fast query execution engine for Apache Spark
by juliangamble on Friday October 20, 2023 @06:06PM
(#37962035)
It would be great to have a comparison to Dataframes and RDDs as well.
[ Parent
| on HN ]
Re:Blaze: Fast query execution engine for Apache Spark
by bllchmbrs on Friday October 20, 2023 @07:31PM
(#37962657)
DataFrames are just SQL. There will be no performance difference.
RDDs will be worse, so it shouldn't matter. No vectorization, no column processing, lots of serialization and de-serialization. They're basically always slower than DataFrames barring some strange use case.