#state-space-models

• 4 Dec 2023 · Paper summary

  Paper summary: Mamba: Linear-Time Sequence Modeling with Selective State Spaces

  Mamba makes state-space model parameters depend on the input, so the model can choose what to remember or forget, and pairs this with a hardware-aware scan: linear-time sequence modelling without attention.