News for hackers. Stuff that matters.
Re:Neural Networks from Scratch by friebetill on Monday October 11, 2021 @01:56PM (#28831006)
I found this 13 min explanation very helpful in understanding backpropagation (https://youtu.be/c36lUUr864M?t=2520).

First he explains the necessary concepts:

1) Chain Rule

2) Computational Graph

Then he explains backpropagation in these three steps (first in general and then with examples):

1) Forward pass: Compute loss

2) Compute local gradients

3) Backward pass: Compute dLoss/dWeights using the Chain Rule

There are no comments on this comment yet.