Proximal Policy Optimization

Explain PPO's probability-ratio objective, clipping, KL control, and the metrics needed to tell whether an update is stable.