Re:Why HTTP/3 is eating the world
by elashri on Thursday October 05, 2023 @07:53AM
(#37777426)
There are many packages that can do that, like Vax [1] and Dask [2]. I don't know exactly your workflow. But the concurrency in python is limited to multiprocessing, which is much expensive than threads which usually a typical streaming parallelizer will use outside python world.
[1] https://vaex.io/docs/index.html
[2] https://docs.dask.org/en/latest/