Lecture 18 – Gradient Descent
Presented by Anthony D. Joseph
Content by Josh Hug, Joseph Gonzalez, Paul Shao
- slides
- video playlist
- code
- code HTML
- (optional) Loss Game
A reminder – the right column of the table below contains Quick Checks. These are not required but suggested to help you check your understanding.
| Video | Quick Check | |
|---|---|---|
| 17.1 Gradient descent in one dimension. Convexity. |
17.1 | |
| 17.2 Various methods of optimizing loss functions in one dimension. |
17.2 | |
| 17.3 Gradient descent in multiple dimensions. Interpretation of gradients. |
17.3 | |
| 17.4 Stochastic gradient descent (SGD). Comparison between gradient descent and SGD. |
17.4 |