* use warmup_ratio as a better default than warmup steps since it's data dependent * replace remainder of warmup_steps
982 B
982 B
* use warmup_ratio as a better default than warmup steps since it's data dependent * replace remainder of warmup_steps