tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

gptq doesn't play well with sample packing

Browse Source
This commit is contained in:
Wing Lian
2023-08-29 12:15:31 -07:00
parent 588cd65a64
commit c820d04669
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/gptq/lora.yml
View File

@@ -20,7 +20,7 @@ val_set_size: 0.01
adapter: lora adapter: lora
lora_model_dir: lora_model_dir:
sequence_len: 4096 sequence_len: 4096
sample_packing: true sample_packing:
lora_r: 8 lora_r: 8
lora_alpha: 32 lora_alpha: 32
lora_dropout: 0.05 lora_dropout: 0.05