Files

Wing Lian 9f824ef76a simplify the example configs to be more minimal and less daunting (#2486 ) [skip ci]

* simplify the example configs to be more minimal and less daunting

* drop empty s2_attention from example yamls

2025-04-04 13:47:26 -04:00

lora-3.5.yaml

simplify the example configs to be more minimal and less daunting (#2486 ) [skip ci]

2025-04-04 13:47:26 -04:00

phi2-ft.yml

simplify the example configs to be more minimal and less daunting (#2486 ) [skip ci]

2025-04-04 13:47:26 -04:00

phi3-ft-fsdp.yml

simplify the example configs to be more minimal and less daunting (#2486 ) [skip ci]

2025-04-04 13:47:26 -04:00

phi3-ft.yml

simplify the example configs to be more minimal and less daunting (#2486 ) [skip ci]

2025-04-04 13:47:26 -04:00

phi-ft.yml

simplify the example configs to be more minimal and less daunting (#2486 ) [skip ci]

2025-04-04 13:47:26 -04:00

phi-qlora.yml

simplify the example configs to be more minimal and less daunting (#2486 ) [skip ci]

2025-04-04 13:47:26 -04:00

README.md

Mixtral fixes 20240124 (#1192 ) [skip ci]

2024-01-24 14:59:57 -05:00

README.md

Phi

Due to some nuances with the phi code, please use deepspeed when training phi for full finetune.

accelerate launch -m axolotl.cli.train examples/phi/phi-ft.yml --deepspeed deepspeed_configs/zero1.json

# OR

python -m axolotl.cli.train examples/phi/phi-qlora.yml