Re:ParaText: CSV parsing at 2.5 GB per second
by aldanor on Wednesday June 08, 2016 @04:28AM
(#11860811)
HDF5 benchmark looks bogus, it's not clear what exactly the author meant by it and how the data was stored/retrieved. With proper filters set up, it should beat any csv reader by both (uncompressed) throughput and runtime
[ Parent
| on HN ]
Re:ParaText: CSV parsing at 2.5 GB per second
by frankmcsherry on Wednesday June 08, 2016 @05:07AM
(#11860941)
It looks like they are comparing (in the chart) throughput on each of their file formats in bytes, rather than records. So, they are slower than HDF5, but eat up more resources doing so (which I think is meant to suggest they are leaving less to waste).