You're pretraining a 7B model for a language with only about 100B usable tokens, with compute for 4 trillion tokens, or 40 passes.

Four passes give nearly the same loss as four times as much fresh text, but each later pass helps less, and by the fortieth a pass is worth about a tenth of new text.