Composability in Julia: Implementing Deep Equilibrium Models via Neural ODEs

Re:Composability in Julia: Implementing Deep Equilibrium Mod... by avikpal1410 on Thursday October 21, 2021 @01:48PM (#28948250)

MDEQ work applies DEQ to some of the large scale benchmarks you mention: https://arxiv.org/pdf/2006.08656.pdf

[ Parent | on HN ]

Re:Composability in Julia: Implementing Deep Equilibrium Mod... by cs702 on Thursday October 21, 2021 @02:03PM (#28948514)

Thank you! The results don't look that great (e.g., EfficientNet models achieve greater accuracy on ImageNet-1000 with ~5x fewer parameters), but the works looks interesting and worthwhile. I'll take a look.

[ Parent | on HN ]