Re:Achieving 10Gbps Line-rate Key-value Stores with FPGAs [pdf]
by erichocean on Sunday November 17, 2013 @11:52PM
(#6752620)
+1 on not needing exotic hardware. This is—while not trivial—not exactly hard today with an Intel E5 processor and it's DPDK.
What's strange is that they used an FPGA at all. The entire industry for network processors is moving the opposite way.
In fact, I've designed systems that go quite a bit beyond simple key-value stores e.g. wire speed polygon indexes with spatial operators. On modern hardware, if the system is efficient, the "put" side of a key-value store should only require a core or two to saturate the wire; the rest of the cores can be dedicated to saturating the outbound "get" side. It is dead simple to do at 1GbE; at 10GbE it does require some skill at high-performance algorithm design but I've seen it done many times.