* use warmup_ratio as a better default than warmup steps since it's data dependent * replace remainder of warmup_steps
967 B
967 B
* use warmup_ratio as a better default than warmup steps since it's data dependent * replace remainder of warmup_steps