Re:Moving away from HDF5
by ycmbntrthrwaway on Thursday January 07, 2016 @04:20PM
(#10860872)
It is right that converting endianness is faster than reading text, but it still requires more code than calling printf and scanf. I am not into big data really and my program spends most of the time computing instead of reading and writing so 10x speedup in I/O is just not worth it. As I said, HDF5 was an overkill in my case.
[ Parent
| on HN ]
The OP, and any other file format spec, needs to be able to read/write large numeric datasets. Printf is very poorly suited to this case.
Your comment is true for your use case, but it's not really responsive to the technical issue here.
Re:Moving away from HDF5
by Dylan16807 on Thursday January 07, 2016 @10:36PM
(#10862763)
for (i=start; i<end; i++) arr[i] = ntohl(arr[i]);
That's not more code than calling printf/scanf.