News for hackers. Stuff that matters.
Re:Linux Code for “Device Memory TCP” – Network to/from Acce... by buildbot on Sunday July 16, 2023 @03:22AM (#36744435)
How is this better than RDMA that is already well supported?

At least with mellanox stuff the last time I touched it, there were I think four levels of reliability, one of which matched TCP.

Re:Linux Code for “Device Memory TCP” – Network to/from Acce... by fulafel on Sunday July 16, 2023 @03:26AM (#36744460)
This sounds like it will work with existing TCP applications.
Re:Linux Code for “Device Memory TCP” – Network to/from Acce... by yokaze on Sunday July 16, 2023 @04:22AM (#36744751)
It's different. Rdma offloads the TCP transfer of host memory to the network device. This is about transferring device memory directly, avoiding going though the host.

Had to read through the lklm message, at it wasn't clear from the article.

Re:Linux Code for “Device Memory TCP” – Network to/from Acce... by _zoltan_ on Sunday July 16, 2023 @04:45AM (#36744858)
RDMA does not offload TCP. Furthermore it's not limited to between NIC memories - for example GPU memory to remote GPU memory works as well.
Re:Linux Code for “Device Memory TCP” – Network to/from Acce... by justinclift on Sunday July 16, 2023 @08:27AM (#36746209)
From what I remember of Infiniband, the network cards are able to do direct PCIe transfers to/from compatible devices attached to the host (eg nvidia quadro gpus).

Specifically to avoid bogging down the host.

Re:Linux Code for “Device Memory TCP” – Network to/from Acce... by KaiserPro on Sunday July 16, 2023 @08:37AM (#36746286)
precisely this. The reason why its worth the expense is that data entering the network is guaranteed to come out the otherside. This kinda eliminates the need for TCP (apart from addressing)
Re:Linux Code for “Device Memory TCP” – Network to/from Acce... by KaiserPro on Sunday July 16, 2023 @08:31AM (#36746239)
This is my first thought, it sounds like inifiniband with with none of the guarantees.

I suppose it means that you can bust out of the local network, and take in "foreign" data. But if you're doing that, you've got bigger problems with data affinity.

Re:Linux Code for “Device Memory TCP” – Network to/from Acce... by ta8645 on Sunday July 16, 2023 @12:46PM (#36748977)
Perhaps it's just avoiding the need to encapsulate an InfiniBand transport packet? I'm not sure how much overhead that introduces in RDMA, but DMTCP may just be an effort to divorce the idea from its original IB underpinnings.
Re:Linux Code for “Device Memory TCP” – Network to/from Acce... by benlwalker on Sunday July 16, 2023 @01:06PM (#36749215)
RDMA is great and similar, but behaves very differently from TCP in the face of network congestion and longer distance traversals. This is essentially trying to get the best parts of TCP and the best parts of RDMA combined.
Re:Linux Code for “Device Memory TCP” – Network to/from Acce... by buildbot on Sunday July 16, 2023 @01:18PM (#36749356)
Wouldn’t that be RoCE? Or iWarp?
Re:Linux Code for “Device Memory TCP” – Network to/from Acce... by benlwalker on Sunday July 16, 2023 @01:35PM (#36749543)
iWARP maybe, but I don't think you want to offload all of TCP to hardware. You want to leave congestion control and all that to software. I don't entirely know if that's why iWARP isn't very popular, but I suspect that's the reason. You want a software TCP stack that can land the data where you want it directly.