News for hackers. Stuff that matters.
Re:Neural Ordinary Differential Equations by joe_the_user on Thursday December 13, 2018 @11:55PM (#18678566)
What results do you have on state of the art metrics?

Also, any outline of how one would go about training one of your systems? What kind of dataset does it do best with?

Re:Neural Ordinary Differential Equations by duvenaud on Friday December 14, 2018 @01:00PM (#18682897)
None in this paper, which is just showing proofs of concept. But our follow-up paper does have SOTA density modeling among the class of efficiently-sample-able generative models. This is because the design of continuous flow models is less constrained than for discrete flows. But other than that, it's still early days for this whole model class.

You train these models in the same way you train a neural network, with stochastic gradient descent. For supervised learning, its main benefit is extra flexibility in the speed/precision tradeoff. For time-series problems, we expect this will ultimately allow us to handle data that's collected at irregular intervals - but we haven't yet moved past the prototype stage in that setting.