Study
Deep Learning · LSTM and GRU
Gated recurrent units: the LSTM's cell state and three gates, the simpler GRU, and an experiment measuring how far gradients reach back through 100 time steps.
- The LSTM's cell state is updated additively through gates, which lets gradients survive many time steps.
- GRU merges the gates into two and has fewer parameters.