Files

Wing Lian e50a64e85e prepared dataset caching, other misc fixes (#665 )

* prepared dataset caching, other misc fixes

* also don't load from disk cache unless explicit

2023-10-02 21:07:24 -04:00

phi-ft.yml

prepared dataset caching, other misc fixes (#665 )

2023-10-02 21:07:24 -04:00

phi-qlora.yml

prepared dataset caching, other misc fixes (#665 )

2023-10-02 21:07:24 -04:00

README.md

make phi training work with Loras (#588 )

2023-09-15 20:51:55 -04:00

README.md

Phi

Due to some nuances with the phi code, please use deepspeed when training phi for full finetune.

accelerate launch -m axolotl.cli.train examples/phi/phi-ft.yml --deepspeed deepspeed/zero1.json

# OR

python -m axolotl.cli.train examples/phi/phi-qlora.yml