News for hackers. Stuff that matters.
Re:200-Year-Old Math Opens Up AI’s Mysterious Black Box by mordae on Tuesday February 28, 2023 @10:59AM (#34970733)
Isn't gradient descent basically PID over parameters? And tricks like momentum basically a low-pass filter integrated in the PID loop? It's quite weird how not that many concepts from analog electronics domain have gotten carried over to ML.

There are no comments on this comment yet.