News for hackers. Stuff that matters.

rocketships

Re:Backprop Alternative: Augmented Lagrangian Predictive Coding on Tuesday September 15, 2026 @04:57AM (#49709684)
There might be only one paper that's trained on full Imagenet using methods like these.

Training a Predictive Coding Network on ImageNet using Equilibrium Propagation Tugdual Kerjan, Rasmus Høier, Benjamin Scellier https://arxiv.org/abs/2606.03584

It's quite an undertaking.

Re:Backprop Alternative: Augmented Lagrangian Predictive Coding on Tuesday September 15, 2026 @04:52AM (#49709643)
This paper uses the "fixed prediction assumption" so I think has caused some confusion (i.e. it's not PC, but PC with a small bandaid). It's a great paper though just the title is misleading somewhat. But all of Beren Millidge's papers are quite good and he was so prolific in the space. Cool to have seen him on the Dwarkesh podcast recently as well.