Lecture 15 – Bias and Variance
Presented by Joey Gonzalez, Andrew Bray, Fernando Perez, and Ani Adhikari
- slides
- 15.5 slides (1, 2)
- video playlist
- Introduction to Overfitting
- Bias-Variance decomposition derivation (raw)
Important: The algebra behind the decomposition of model risk into observational variance, model variance, and bias, is not in the slides or video but is in the link above. You should read it after watching this lecture. Also, you may want to review Lecture 3 for a refresher on random variables.
| Video | Quick Check | |
|---|---|---|
| 15.0 Weekly Overview. |
||
| 15.1 A quick Introduction to Overfitting and Generalization. |
Coming soon | |
| 15.2 Variance of random variables. Walking through an alternate calculation of variance. Variance of a linear transformation. |
15.2 | |
| 15.3 Introducing the data generating process and prediction error. Model risk. |
15.3 | |
| 15.4 Components of the Prediction Error. |
15.4 | |
| 15.5 Visualizing Bias and Variance. |
Coming Soon | |
| 15.6 Model Complexity and the Bias Variance Tradeoff. |
Coming Soon |