Sahaj.blogs

Day page

9 Jan 2025

Study

Deep Learning · Multilayer perceptron

Adding a hidden layer with a non-linear activation turns the perceptron into an MLP that can solve XOR; a forward pass written in NumPy.

  • A hidden layer with a non-linearity lets the network bend its decision boundary.
  • Stacking linear layers without activations collapses back into one linear layer.

Read the post →