Content
This post is to introduce the backpropagation in details. Backpropagation, in other words, is based on total differential formula and chain rule, which has a forward pass and a backward pass. The gradient for each weight (wi) is obtained by multiplying the partial derivatives from two passes.
Reference: Backpropagation slides. Note credit: Sakura-gh.
