* use warmup_ratio as a better default than warmup steps since it's data dependent * replace remainder of warmup_steps
921 B
921 B
* use warmup_ratio as a better default than warmup steps since it's data dependent * replace remainder of warmup_steps