News for hackers. Stuff that matters.
Re:21 GB/s CSV Parsing Using SIMD on AMD 9950X by constantcrying on Friday May 09, 2025 @02:44PM (#43939855)
There are very good alternatives to csv for storing and exchanging floating point/other data.

The HDF5 format is very good and allows far more structure in your files, as well as metadata and different types of lossless and lossy compression.

Re:21 GB/s CSV Parsing Using SIMD on AMD 9950X by jsploit on Sunday May 11, 2025 @10:42PM (#43959168)
The lack of concurrent access support in the official HDF5 library (the only implementation with full format support) can be a major drawback. There is ongoing work on that front [1] though it's unclear when it will land.

[1] https://github.com/LifeboatLLC/MT-HDF5