Tag: sequence length curriculum
How Training Duration and Token Counts Affect LLM Generalization
Explore how training duration and token counts impact LLM generalization. Learn why variable sequence lengths beat raw scale and avoid the generalization valley.
