InferenceMultiple choiceMediumCopy prompt

How would you decode to keep the text varied without falling into the unreliable tail?

1. AAlways sample from the 40 most likely words, whatever their probabilities.
2. BSample from the smallest set of words whose probabilities add up to $p$.
3. CWiden the beam so the search keeps more candidate sentences at each step.
4. DSample from the whole distribution at a low temperature, like 0.3.