#regularisation

• 6 Mar 2025 · Study

  Deep Learning · Dropout

  Dropout randomly zeroes activations during training as a regulariser; inverted scaling, train vs eval behaviour, and its effect on an overfitting MLP.

• 4 Sept 2024 · Study

  Machine Learning · Regularisation: ridge and lasso

  Overfitting with too many features, and how L2 (ridge) shrinks weights while L1 (lasso) drives some exactly to zero.