You've trained a process reward model on human labels marking each step of a math solution correct or incorrect, and at test time you sample many solutions per problem and submit one.
You've trained a process reward model on human labels marking each step of a math solution correct or incorrect, and at test time you sample many solutions per problem and submit one.