Advanced
Pro
PPO & Modern Policy Optimization Quiz
Test your understanding of why unconstrained policy gradient steps collapse policies, TRPO's trust region, PPO's clipped surrogate objective, Generalized Advantage Estimation, implementation details, and the connection to RLHF.
12 questions
10 min
Pass: 70%