Re:CSV Reader Benchmarks: Julia Reads CSVs 10-20x Faster tha...
by mlthoughts2018 on Wednesday October 14, 2020 @10:09PM
(#24784060)
I do have code I can show, but I do not want to reveal my GitHub username attached to my Hacker News account.
Thankfully you don’t have to rely on me - tons of name brand Python scientific tools use Cython for speedups.
Pandas, for example, uses Cython heavily. Here is an example tutorial that may help you,
https://pandas.pydata.org/pandas-docs/stable/user_guide/enha...
Same with Numba, despite its promises, I've never seen anything close to 100x speedups in the real world, and I've even seen a fair few cases where numba resulted in slower code compared to 'pure' python/numpy (although admittedly that was 2-3 years ago)
Sure I could probably design some pathological code where you might see 100x speed up by just adding type annotations, but that would probably require starting with some really inefficient python code.