Join free to take this lesson
Anyone can look around, but taking a lesson needs a free account. With one, your answers are checked step by step and your progress is saved, so you can stop and pick up where you left off on any device.
9 steps ยท about 16 min
By the end you can
- Explain the roles of training, validation and test data
- Compute a k-fold cross-validation estimate and count the models it fits
- Recognise data leakage and test-set reuse
Who it is for: You know training and test error (lesson 15.1) and regularisation (lesson 15.2).
The steps
- Tuning on the test set
- Three jobs, three sets of data
- k-fold cross-validation
- A CV estimate
- How much data trains each model?
- Counting fits
- Spot the leak
- Data in time order
- Report honestly
Discussion 0 comments
Log in to join the discussion.