Files

Brian Fitzgerald cf64284a04 Phi-3 conversation format, example training script and perplexity metric (#1582 )

* phi-3 support and perplexity metric

* phi-3 chat template

* metrics updates

* chore: lint

* fix assertion on Tensor

* fix tests since tokenization happens in the metric

* fix perplexity value of shorter passage

---------

Co-authored-by: Wing Lian <wing.lian@gmail.com>

2024-06-04 16:11:56 -04:00

phi2-ft.yml

update outputs path so that we can mount workspace to /workspace/data (#1623 )

2024-05-15 12:44:13 -04:00

phi3-ft.yml

Phi-3 conversation format, example training script and perplexity metric (#1582 )

2024-06-04 16:11:56 -04:00

phi-ft.yml

update outputs path so that we can mount workspace to /workspace/data (#1623 )

2024-05-15 12:44:13 -04:00

phi-qlora.yml

update outputs path so that we can mount workspace to /workspace/data (#1623 )

2024-05-15 12:44:13 -04:00

README.md

Mixtral fixes 20240124 (#1192 ) [skip ci]

2024-01-24 14:59:57 -05:00

README.md

Phi

Due to some nuances with the phi code, please use deepspeed when training phi for full finetune.

accelerate launch -m axolotl.cli.train examples/phi/phi-ft.yml --deepspeed deepspeed_configs/zero1.json

# OR

python -m axolotl.cli.train examples/phi/phi-qlora.yml