They come with PCIE lanes and 2 10Gig ethernet on board the SoC and you have CompactPCI form factor AIB cards with Xeon Ds already. https://www.men.de/products/cpu-boards/g25a/
This is what Intel has to combat the threat from ARM and beyond, these SOCs are quite popular now for both compute heavy industrial use (e.g. collision detection systems for aircraft, boats, and heavy duty vehicles) and for small form factor servers.
SuperMicro for example offers Micro-Blade server where 56 Xeon-D SoCs are fit into a 6u chassis that's 896 cores / 1792 threads in a single 6U server or 6272c/12544t in a full 42u rack.
Wholeserver implementations are available from vendors like SuperMicro and HP.
Small form factor barebones micro-ATX/flex-ATX are also available from vendors or as OEM parts.
Google even google shopping has links for the more commercial general purpose parts.
http://ark.intel.com/products/family/87041/Intel-Xeon-Proces...
If they can't produce a cost-effective, power-efficient system with 64-256 cores then ARM will eat their lunch in a good chunk of the server market and NVidia will destroy any hope they had to get back in the supercomputer game.
I'm not saying Intel can't do it, but they sure are in a bind now. Their flagship product is a stupidly expensive 14 core Xeon that only appeals to a narrow market segment. They really don't have an answer for ARM when it comes to massively parallel server installations, and those companies, the Google and Facebook types, buy a lot of hardware.