tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Fix the wrong adapter in qwen2-moe-qlora example (#1501) [skip ci]

Browse Source 
It should be `qlora` instead of `lora`
This commit is contained in:
Maziyar Panahi
2024-04-09 16:57:24 +02:00
committed by GitHub
parent ff01c45127
commit 7f17eff81a
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/qwen/qwen2-moe-qlora.yaml
View File

@@ -16,7 +16,7 @@ sequence_len: 1024 # supports up to 32k
sample_packing: false sample_packing: false
pad_to_sequence_len: false pad_to_sequence_len: false
adapter: lora adapter: qlora
lora_model_dir: lora_model_dir:
lora_r: 32 lora_r: 32
lora_alpha: 16 lora_alpha: 16