Re:CSV Reader Benchmarks: Julia Reads CSVs 10-20x Faster tha...
by klhugo on Sunday October 11, 2020 @12:53PM
(#24747150)
And fast! I got easily 3 orders of magnitude speedup. I used to load CSVs with pandas and do typical filtering operations... oh boy, some of the stuff would take a hole morning, not to mention the memory usage. I do all that in minutes now.
[ Parent
| on HN ]
Re:CSV Reader Benchmarks: Julia Reads CSVs 10-20x Faster tha...
by benhurmarcel on Monday October 12, 2020 @09:26AM
(#24754113)
Sorry if that sounds stupid, but then when you get a csv file you write it to an SQLite file before doing computations?