Re:Blaze: Fast query execution engine for Apache Spark
by bllchmbrs on Friday October 20, 2023 @07:31PM
(#37962657)
DataFrames are just SQL. There will be no performance difference.
RDDs will be worse, so it shouldn't matter. No vectorization, no column processing, lots of serialization and de-serialization. They're basically always slower than DataFrames barring some strange use case.
RDDs will be worse, so it shouldn't matter. No vectorization, no column processing, lots of serialization and de-serialization. They're basically always slower than DataFrames barring some strange use case.