Re:200-Year-Old Math Opens Up AI’s Mysterious Black Box
by mordae on Tuesday February 28, 2023 @10:59AM
(#34970733)
Isn't gradient descent basically PID over parameters?
And tricks like momentum basically a low-pass filter integrated in the PID loop? It's quite weird how not that many concepts from analog electronics domain have gotten carried over to ML.
http://www.ecircuitcenter.com/Circuits/op_pid/op_pid.htm
https://www.nutsvolts.com/magazine/article/the_perceptron_ci...