True. And with RPi4 having a 1000baseT, it’s not as painful as it seems. Perhaps even the driver can be coaxed into some form of DMA and MPI that is a bit lower latency than IP stack.
With secondary IP layer on 802.11, it might actually work reasonably well.
Or use the PCIe mod and use an infiniband card for low latency and high thoughput.
But as with everything high performance, it depends entirely on the use case.