I did some FPGA stuff at university, I'm more comfortable there for sure, but only on a dev board someone else has made - I'd have the same problem getting started with designing an FPGA board as I described for USB/HDMI/etc. above.