Files

Wing Lian 12a2dbbc2c Support Sample packing for phi arch (#586 )

* phi sequence packing

* sample packing fixes

* fix linting

* fix inference and phi e2e tests

* update phi example now that sample packing works

* wandb import keeps getting moved around

2023-09-15 15:46:54 -04:00

phi-ft.yml

Support Sample packing for phi arch (#586 )

2023-09-15 15:46:54 -04:00

README.md

Phi examples (#569 )

2023-09-14 11:17:47 -04:00

README.md

Phi

Due to some nuances with the phi code, please use deepspeed when training phi.

accelerate launch scripts/finetune.py examples/phi/phi-ft.yml --deepspeed deepspeed/zero1.json