Book VII · Chapter 2

Policy optimization

Build policy gradients, actor-critic methods, advantage estimation, and PPO.

Priority

Specialist

Difficulty

Advanced

Useful for

RS, RE, Post-training, Robotics

Interview rounds

Research, Post-training

Read first: RL foundations and value methods