* use warmup_ratio as a better default than warmup steps since it's data dependent * replace remainder of warmup_steps
MPT-7B
accelerate launch scripts/finetune.py examples/mpt-7b/config.yml
* use warmup_ratio as a better default than warmup steps since it's data dependent * replace remainder of warmup_steps
accelerate launch scripts/finetune.py examples/mpt-7b/config.yml