Files

Dan Saunders 10ba1622f7 checkpoint model on first step callback (#2906 )

* checkpoint model on first step callback

* remove debug

* add test cases; update existing tests not to save on first step

* move test out of solo

* delete

* default to False

* typo

2025-07-15 15:00:48 -04:00

lora-3.5.yaml

checkpoint model on first step callback (#2906 )

2025-07-15 15:00:48 -04:00

phi2-ft.yml

checkpoint model on first step callback (#2906 )

2025-07-15 15:00:48 -04:00

phi3-ft-fsdp.yml

checkpoint model on first step callback (#2906 )

2025-07-15 15:00:48 -04:00

phi3-ft.yml

checkpoint model on first step callback (#2906 )

2025-07-15 15:00:48 -04:00

phi-ft.yml

checkpoint model on first step callback (#2906 )

2025-07-15 15:00:48 -04:00

phi-qlora.yml

checkpoint model on first step callback (#2906 )

2025-07-15 15:00:48 -04:00

README.md

Mixtral fixes 20240124 (#1192 ) [skip ci]

2024-01-24 14:59:57 -05:00

README.md

Phi

Due to some nuances with the phi code, please use deepspeed when training phi for full finetune.

accelerate launch -m axolotl.cli.train examples/phi/phi-ft.yml --deepspeed deepspeed_configs/zero1.json

# OR

python -m axolotl.cli.train examples/phi/phi-qlora.yml