Rust 1.46 - Hackdot

Re:Rust 1.46 by Fiahil on Thursday August 27, 2020 @07:33PM (#24299880)

column-wide map-reduce over large dataframes usually give you a 1000x or so speedup.

With rust you can stream each record and leverage the insane parallelism and async-io libs (rayon, crossbeam, tokio) and a very small memory footprint. sure you have asyncio in python but that’s nowhere near the speed of tokio.

[ Parent | on HN ]

Re:Rust 1.46 by datanecdote on Thursday August 27, 2020 @09:27PM (#24300509)

Thanks for the pointers, those crates seem great. The flaky multithreading libs are my least favorite part of python, and rust’s strength in this area seems very appealing.

[ Parent | on HN ]