af8d257aa2
* make pad_to_sequence_len default to the same value as sample_packing * remove duplicate validation * fix test * update description meta Co-authored-by: NanoCode012 <nano@axolotl.ai> --------- Co-authored-by: NanoCode012 <nano@axolotl.ai>
Phi
Due to some nuances with the phi code, please use deepspeed when training phi for full finetune.
accelerate launch -m axolotl.cli.train examples/phi/phi-ft.yml --deepspeed deepspeed_configs/zero1.json
# OR
python -m axolotl.cli.train examples/phi/phi-qlora.yml