Files

Wing Lian 228420972e Phi examples (#569 )

* add phi full ft example

* Add readme to point out that deepspeed should be used

* zero1 is better than zero2 for phi

2023-09-14 11:17:47 -04:00

Phi

Due to some nuances with the phi code, please use deepspeed when training phi.

accelerate launch scripts/finetune.py examples/phi/phi-ft.yml --deepspeed deepspeed/zero1.json