AI & ML Engineering · Unit 8 · Machine Learning
Model Evaluation
Measuring whether a model is good, and whether it will stay good on new data.
- 8.1Video
Train, Validation and Test Sets
Splitting data correctly and avoiding data leakage.
- 8.2Video
Cross-Validation
K-fold validation and getting a reliable estimate of performance.
- 8.3Video
Classification Metrics
Accuracy, precision, recall, F1, ROC and the confusion matrix.
- 8.4Video
Regression Metrics
MAE, RMSE and R-squared, and when each one misleads.
- 8.5Video
Bias, Variance and Overfitting
Diagnosing underfitting and overfitting with learning curves.
- 8.6Video
Class Imbalance
Resampling, class weights and choosing the right metric.
- 8.7Video
Hyperparameter Tuning
Grid search, random search and Bayesian optimisation.
Unit project
An evaluation report that compares three models on the same problem and recommends one, with the trade-offs stated.
Paid learners get the full brief, submit it from their dashboard and have it reviewed. It goes in your portfolio.
Open every unit
Enrol once to open every unit, its videos and a reviewed project for your portfolio.