News for hackers. Stuff that matters.

A comment on Russ’ 10 Ingredient Recipe for Making 1 Million TPS on $5K Hardware. Parent comment

Re:Russ’ 10 Ingredient Recipe for Making 1 Million TPS on $5... by wmf on Sunday July 28, 2013 @10:45PM (#6119082)
Of course, if you use Netmap/DPDK/PF_RING you have to bring your own TCP stack, which is more than many app developers are comfortable with.
[ Parent | on HN ]
Re:Russ’ 10 Ingredient Recipe for Making 1 Million TPS on $5... by colanderman on Sunday July 28, 2013 @10:50PM (#6119095)
Excellent point which I missed :) Can you tell I live in an L3 bubble?

I am surprised (from a quick Google) there is no open-source user-space PF_RING-aware TCP stack. Am I missing something?

[ Parent | on HN ]
Re:Russ’ 10 Ingredient Recipe for Making 1 Million TPS on $5... by wmf on Sunday July 28, 2013 @11:13PM (#6119153)
When you're doing packet capture that normally costs one system call per packet, Netmap/DPDK/PF_RING are a clear win. But with TCP a single system call can send or receive many packets and TSO/LRO offloads help even more. I haven't seen any numbers about the benefits of kernel bypass for TCP; maybe SolarFlare has some.
[ Parent | on HN ]
Re:Russ’ 10 Ingredient Recipe for Making 1 Million TPS on $5... by itchyouch on Monday July 29, 2013 @09:36AM (#6120981)
I was about to point out solarflare's openonload. Its only compatible with an sfc nic though. With onload, i've seen about a 20% throughput increase when turning onload on.
[ Parent | on HN ]
Re:Russ’ 10 Ingredient Recipe for Making 1 Million TPS on $5... by justincormack on Monday July 29, 2013 @04:59AM (#6120009)
No I don't think you are, at least for open source production grade. Intending to do some work on this when I get a chance. There is a talk at Eurobsdcon this year on using the FreeBSD network stack in userspace and Netbsd also an option, fixing locking and interrupts are issues with using these stacks out of kernel to get good performance as the environment is rather different.
[ Parent | on HN ]