Study
Deep Learning · RNN
Recurrent networks carry a hidden state across time steps; the unrolled view, nn.RNN shapes, and why gradients vanish over long sequences.
- An RNN applies the same cell at every time step, passing a hidden state forward like memory.
- Backprop through time multiplies many Jacobians, so gradients for early steps tend to vanish.