Re:21 GB/s CSV Parsing Using SIMD on AMD 9950X
by hinkley on Saturday May 10, 2025 @01:39AM
(#43943463)
There’s a calculation for ns/row in the article that is never translated into rows per second but is about 27 ns/row, which is about 37,000 per second. Which means these rows are 570k apiece if that’s 21GB. Which seems like an awfully cooked benchmark.
Re:21 GB/s CSV Parsing Using SIMD on AMD 9950X
by aolo2 on Saturday May 10, 2025 @02:45AM
(#43943682)
That would be 37,000,000, not 37,000.
Re:21 GB/s CSV Parsing Using SIMD on AMD 9950X
by hinkley on Saturday May 10, 2025 @09:36AM
(#43945508)
So ~570 per line. Still seems a bit contrived. I’d expect a SIMD version to still work line by line but I don’t know that I would try to shove that much into a line if I wanted to read it really fucking fast.
- What format exactly is it parsing? (eg. does the dialect of CSV support quoted commas, or is the parser merely looking for commas and newlines)?
- What is the parser doing with the result (ie. populating a data structure, etc)?