Study
Deep Learning · Backpropagation
Backpropagation as the chain rule applied layer by layer; a two-layer network trained on XOR in pure NumPy, plus a numerical gradient check.
- Backprop computes every gradient in one backward pass by reusing the chain rule from the output toward the input.
- A numerical gradient check catches most backprop bugs.