Omniadisce

Applied maths 15.4: Cross-validation

Lesson Advanced

Join free to take this lesson

Anyone can look around, but taking a lesson needs a free account. With one, your answers are checked step by step and your progress is saved, so you can stop and pick up where you left off on any device.

9 steps ยท about 16 min

By the end you can

  • Explain the roles of training, validation and test data
  • Compute a k-fold cross-validation estimate and count the models it fits
  • Recognise data leakage and test-set reuse

Who it is for: You know training and test error (lesson 15.1) and regularisation (lesson 15.2).

The steps

  1. Tuning on the test set
  2. Three jobs, three sets of data
  3. k-fold cross-validation
  4. A CV estimate
  5. How much data trains each model?
  6. Counting fits
  7. Spot the leak
  8. Data in time order
  9. Report honestly

Discussion 0 comments

Log in to join the discussion.

× Enlarged view