RLVRYou train on math with GRPO and a verifier that rewards correct final answers. Early on the policy's entropy collapses: samples in many groups come out nearly identical and accuracy stalls.
The PPO-style clip at caps how far any token's probability can rise per update, which hits rare tokens hardest.