News for hackers. Stuff that matters.
Re:Why Julia's DataFrames Are Still Slow by heydenberk on Sunday November 29, 2015 @09:54AM (#10644708)
If I understand you, this is indeed possible and has been recently implemented in Python. Take a look at dask: http://dask.pydata.org/en/latest/

> Users interact with dask either by making graphs directly or through the dask collections which provide larger-than-memory counterparts to existing popular libraries:

Re:Why Julia's DataFrames Are Still Slow by digitalzombie on Sunday November 29, 2015 @10:27AM (#10644800)
Just to clarify, OP statement of "out of the core" means concurrent processes?
Re:Why Julia's DataFrames Are Still Slow by chubot on Sunday November 29, 2015 @12:26PM (#10645275)
I think he means operating on data that doesn't fit in memory, and as mentioned I think R and Python both have packages for that.
Re:Why Julia's DataFrames Are Still Slow by IndianAstronaut on Sunday November 29, 2015 @11:19PM (#10647671)
Dask looks quite interesting. Though I am running into some issues with merges and such.

My temporary fix is to use the chunking functionality of Pandas.