For each competition math problem you sample hundreds of step-by-step solutions, and a reward model trained on one label per solution, whether the final answer was correct, picks one to submit.

Its picks often reach the right answer through a wrong step, like a dropped sign or an unjustified jump, and on harder problems it favors confident solutions whose reasoning broke halfway through.