News for hackers. Stuff that matters.
Re:Going faster than memcpy by 6keZbCECT2uB on Monday August 11, 2025 @01:33AM (#44861004)
I've been meaning to look at Iceoryx as a way to wrap this.

Pytorch multiprocessing queues work this way, but it is hard for the sender to ensure the data is already in shared memory, so it often has a copy. It is also common for buffers to not be reused, so that can end up a bottleneck, but it can, in principle, be limited by the rate of sending fds.

Re:Going faster than memcpy by elBoberido on Friday August 15, 2025 @11:28AM (#44913590)
Btw, with the next release iceoryx2 will have Python bindings. They are already on main and we will make it available via PIP. This should make it easier to use with Pytorch.