Omniadisce

Applied maths 15.2: Regularisation

Lesson Advanced

Join free to take this lesson

Anyone can look around, but taking a lesson needs a free account. With one, your answers are checked step by step and your progress is saved, so you can stop and pick up where you left off on any device.

10 steps ยท about 16 min

By the end you can

  • Write the ridge and lasso objectives and say what $\lambda$ does
  • Compute a one-variable ridge estimate $\hat\beta = \sum xy / (\sum x^2 + \lambda)$
  • Explain why lasso can set coefficients to exactly zero and why features must be standardised

Who it is for: You know least squares (lesson 7.6) and the bias-variance trade-off (lesson 15.1).

The steps

  1. Pay for size
  2. Ridge and lasso
  3. Ridge with one input
  4. A ridge estimate
  5. How much shrinkage?
  6. The penalty
  7. Exactly zero
  8. Choosing lambda
  9. Units matter
  10. When to regularise

Discussion 0 comments

Log in to join the discussion.

× Enlarged view