Book II · Chapter 2

Optimization and schedules

Move from SGD and Adam to schedules, clipping, and initialization.

Priority

Core

Difficulty

Intermediate

Useful for

All ML roles

Interview rounds

ML breadth, Training, Research

Read first: Objectives and regularization