leokoz8

It is in Applied Optimal Control by Bryson and Ho (1969). Yann LeCun acknowledges this in his 1989 paper on backpropagation:https://new.math.uiuc.edu/MathMLseminar/seminarPapers/LeCunB....

> "Since his first work on the subject, the author has found that A. Bryson and Y.-C. Ho [Bryson and Ho, 1969] described the backpropagation algorithm using Lagrange formalism. Although their description was, of course, within the framework of optimal control rather than machine learning, the resulting procedure is identical to backpropagation."

Hi, one of the authors here (Leo).

To clear up some confusion:

1) The paper proves an architectural equivalence between two models: neuron-astrocyte networks and Transformers. This is different from studies of representational similarity, which look at Transformer "responses" and compare them to brain responses using regression techniques.

2) The paper provides testable hypotheses for what astrocytes are doing. We can either succeed or fail at rejecting those hypotheses after comparing to real brain data. That is future work.

Happy to answer questions.

- Leo