Applied maths 15.1: Bias, variance and overfitting
Why the model that fits your data best is often the worst at predicting new data, and how test error splits into bias, variance and noise. With 10 data points, a polynomial of degree 9 passesโฆ
9 posts match
Why the model that fits your data best is often the worst at predicting new data, and how test error splits into bias, variance and noise. With 10 data points, a polynomial of degree 9 passesโฆ
Ridge and lasso: penalise large coefficients to trade a little bias for a lot less variance. A model with 500 inputs fitted to 200 patients will happily find 'effects' that are pure noiseโฆ
Logistic regression turns a score into a probability; the confusion matrix, precision and recall say how good the classifier really is. A test for a rare disease that simply says 'healthy' toโฆ
Estimate test error without wasting data, choose models and tuning parameters honestly, and avoid data leakage. Many published models fail in the real world for one reason: somewhere, informationโฆ
Decision trees split data into boxes by asking yes/no questions; random forests and boosting combine many trees into one strong model. The models that win most competitions on tables of data areโฆ
Gradient descent fits a model by walking downhill on its loss; a neural network is layers of simple units fitted that way. A language model has billions of numbers to fit, and no formula givesโฆ
k-means groups unlabelled data into clusters; principal component analysis finds the few directions that carry most of the variation. A shop has a million customers and no labels. Which of themโฆ
Fifteen questions across statistical modelling and machine learning, with new numbers on every attempt. Pass at 80 % to move on. This is where you find out what you can do without help. Eachโฆ
Open and closed loops, proportional-integral-derivative control, steady-state error and stability margins, tried on a real tuning task. A cruise control holds 100 km/h uphill and downhill withoutโฆ