It'd be very interesting to see how you do this with an FPGA, that would be quite the accomplishment, especially given the monstrous compute capability that GPUs give, and the communications between high level (say: python) and low level (a GPU or some other co-processor) have all been worked out and debugged for GPUs.
If there is room for FPGA work in there it would probably be some specialized function.
Regardless I'd love a write-up if you do this.
What is really going to slaughter you for ML performance on FPGAs is memory bandwidth.
If you have access to a really big FPGAs with lots of memory (on the order of $10-30k...) it might make a difference.
These include SNN implementations on field-programmable gate arrays (FPGAs), one that is trained using a mixture of unsupervised/supervised learning [61] and another that is trained using a GA [62]
An initial implementation of DANNA on field programmable gate arrays (FPGAs)
Isn't that describing a Field Programmable Gate Array: memory embedded in a sea of logic cells?
What's the best resource to get someone who knows FPGAs, a decent amount of maths and 1990s style neural nets up to speed on today's deep neural networks?