News for hackers. Stuff that matters.

A comment on Show HN: High-performance ahead-of-time compiler for Machine Learning. Parent comment

Re:Show HN: High-performance ahead-of-time compiler for Mach... by p1esk on Friday December 14, 2018 @12:26AM (#18678660)
I see. So what do you intend it to become? Are you building a middleware to be inserted between, say, PyTorch and cuDNN? I'm training convnets and rnns written in PyTorch and TF on GPUs, how can I benefit from your work?
[ Parent | on HN ]
Re:Show HN: High-performance ahead-of-time compiler for Mach... by andrew-wja on Friday December 14, 2018 @05:11AM (#18679769)
You're essentially correct, but there is a bit of a problem with PyTorch and TF specifically, because you don't really have a definition of the model per se. You construct it dynamically using a Python or C++ program.

The Caffe .prototxt format or the ONNX model format are nice declarative specifications for what the model is supposed to do; so those are good input formats for the compiler. I hope more frameworks will prioritize ONNX, because it's really the wild west out here with every framework reinventing the wheel for model specification!

[ Parent | on HN ]