tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

Phi update 202311 (#876)

Browse Source 
* add phi modeling from hf

* update for packing and use new modeling class for phi

* update e2e tests for phi to use new model name

* update example phi to also use new phi model name

* use AutoModelForCausalLM for phi lora since sample packing isn't supported
This commit is contained in:
Wing Lian
2023-11-17 12:47:17 -05:00
committed by GitHub
parent 797f3dd1de
commit 9bf854e59c
6 changed files with 1136 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/phi/phi-ft.yml
View File

@@ -1,5 +1,5 @@
base_model: microsoft/phi-1_5
model_type: MixFormerSequentialForCausalLM
model_type: PhiForCausalLM
tokenizer_type: AutoTokenizer
is_llama_derived_model: false
trust_remote_code: true