Re:21 GB/s CSV Parsing Using SIMD on AMD 9950X
by jsploit on Sunday May 11, 2025 @10:42PM
(#43959168)
The lack of concurrent access support in the official HDF5 library (the only implementation with full format support) can be a major drawback. There is ongoing work on that front [1] though it's unclear when it will land.
The HDF5 format is very good and allows far more structure in your files, as well as metadata and different types of lossless and lossy compression.