Numba can usually speed up non-vectorizable things by JIT compiling and potentially parallelizing.

I mean, in an ideal world you'd use Julia or a Cython extension, but if you already have something in Python/numpy, numba only requires you add a decorator to your function and it gets jitted.