tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Phi examples (#569)

Browse Source 
* add phi full ft example

* Add readme to point out that deepspeed should be used

* zero1 is better than zero2 for phi
This commit is contained in:
Wing Lian
2023-09-14 11:17:47 -04:00
committed by GitHub
parent c6d870b91d
commit 228420972e
2 changed files with 82 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
examples/phi/README.md Normal file
View File

@@ -0,0 +1,7 @@
# Phi
Due to some nuances with the phi code, please use deepspeed when training phi.
```shell
accelerate launch scripts/finetune.py examples/phi/phi-ft.yml --deepspeed deepspeed/zero1.json
```