News for hackers. Stuff that matters.
Re:Is a Dataframe Just a Table? (2019) [pdf] by nikhizzle on Tuesday February 11, 2020 @05:16AM (#22297368)
I think you are describing something close to the Dataset API in Spark. Spark is built on the RDD, a novel data structure that creates transparent concurrency and distribution. Additionally, you can access the same data with 4 APIs, one of which is SQL, and another which is a typed functional API.

The RDD paper is one of my favorite papers, and is great bed time reading.

https://www.usenix.org/system/files/conference/nsdi12/nsdi12...

There are no comments on this comment yet.