News for hackers. Stuff that matters.
Re:What's Next for R? by xiaodai on Friday December 27, 2019 @07:17PM (#21896068)
For larger-than-RAM data I would recommend diskframe.com

It uses dplyr and data.table syntax to manipulate data on disk

Re:What's Next for R? by phillc73 on Saturday December 28, 2019 @05:01AM (#21898132)
I've not used diskframe.com, but from experience can recommend the 'fst'[1] file format with 'fsttable'[2] for reading on disk data tables.

[1] https://github.com/fstpackage/fst

[2] https://github.com/fstpackage/fsttable

Re:What's Next for R? by xiaodai on Saturday December 28, 2019 @04:27PM (#21901857)
disk.frame uses fst as the underlying format
Re:What's Next for R? by meztez on Friday December 27, 2019 @07:29PM (#21896129)
Thanks, so far we just scaled up our vm ram but i might find a use for it.