Re:FastSpark: A New Fast Native Implementation of Spark from...
by RocketSyntax on Thursday October 31, 2019 @03:18PM
(#21412555)
distributed in-memory computing for massive datasets to big to fit into vertically scaled memory. generic tabular files, not tables. delta lake.
[ Parent
| on HN ]
Re:FastSpark: A New Fast Native Implementation of Spark from...
by truth_seeker on Friday November 01, 2019 @01:01AM
(#21416400)
Yes those features help and all of the distributed SQL databases have data and query cache.
Re:FastSpark: A New Fast Native Implementation of Spark from...
by RocketSyntax on Friday November 01, 2019 @09:34AM
(#21418572)
Then once the subset of data is in distributed memory... you hittem w pyspark and all compatible libraries.