Bank
50 / 87
Training stabilityShort answerMedium

You're starting a new RNN language model and want gradient norm clipping from the first step.

Nobody on the team has trained this architecture before, so there's no threshold to copy.

How would you pick the threshold, and how would you tell whether clipping is helping or hiding a problem?