Files

Wing Lian 5f79b8242f new evals_per_epoch and saves_per_epoch to make things cleaner (#944 )

* new evals_per_epoch and saves_per_epoch to make things cleaner

* update per PR feedback

2023-12-12 15:35:23 -05:00

phi-ft.yml

new evals_per_epoch and saves_per_epoch to make things cleaner (#944 )

2023-12-12 15:35:23 -05:00

phi-qlora.yml

new evals_per_epoch and saves_per_epoch to make things cleaner (#944 )

2023-12-12 15:35:23 -05:00

README.md

make phi training work with Loras (#588 )

2023-09-15 20:51:55 -04:00

README.md

Phi

Due to some nuances with the phi code, please use deepspeed when training phi for full finetune.

accelerate launch -m axolotl.cli.train examples/phi/phi-ft.yml --deepspeed deepspeed/zero1.json

# OR

python -m axolotl.cli.train examples/phi/phi-qlora.yml