CSV Reader Benchmarks: Julia Reads CSVs 10-20x Faster than Python and R

Re:CSV Reader Benchmarks: Julia Reads CSVs 10-20x Faster tha... by mynegation on Sunday October 11, 2020 @12:00PM (#24746679)

Because it is not a bottleneck. Modern SSDs can read data at more than 500 megabytes per second, which, on a single thread gives you just about 6-8 clock cycles to process a single byte. That’s not a lot of CPU instructions so it will take quite a number of threads to handle this bandwidth.

[ Parent | on HN ]

Re:CSV Reader Benchmarks: Julia Reads CSVs 10-20x Faster tha... by jdietrich on Sunday October 11, 2020 @12:11PM (#24746761)

The SSD in my current workstation tops out at 5GB/s sequential reads and 680kIOPS. That's a modestly high-end consumer M.2 drive, not enterprise exotica. SSDs are really, really fast.

[ Parent | on HN ]

Re:CSV Reader Benchmarks: Julia Reads CSVs 10-20x Faster tha... by xiaodai on Sunday October 11, 2020 @06:54PM (#24749823)

Yeah Intel optane and the like will be even faster.

[ Parent | on HN ]