Files

Wing Lian 9bf854e59c Phi update 202311 (#876 )

* add phi modeling from hf

* update for packing and use new modeling class for phi

* update e2e tests for phi to use new model name

* update example phi to also use new phi model name

* use AutoModelForCausalLM for phi lora since sample packing isn't supported

2023-11-17 12:47:17 -05:00

phi-ft.yml

Phi update 202311 (#876 )

2023-11-17 12:47:17 -05:00

phi-qlora.yml

simplify by removing duplicate base_model_config (#772 )

2023-10-23 01:42:38 -04:00

README.md

make phi training work with Loras (#588 )

2023-09-15 20:51:55 -04:00

README.md

Phi

Due to some nuances with the phi code, please use deepspeed when training phi for full finetune.

accelerate launch -m axolotl.cli.train examples/phi/phi-ft.yml --deepspeed deepspeed/zero1.json

# OR

python -m axolotl.cli.train examples/phi/phi-qlora.yml