tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 4 Packages Projects Releases Wiki Activity

Update qlora.yml - remove max_packed_sequence_len (#1210) [skip ci]

Browse Source
This commit is contained in:
Igor Berlenko
2024-01-26 20:43:05 +08:00
committed by GitHub
parent 74c72ca5eb
commit 5407ddd233
1 changed files with 0 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
examples/cerebras/qlora.yml
View File

@@ -11,7 +11,6 @@ val_set_size: 0.05
adapter: qlora adapter: qlora
lora_model_dir: lora_model_dir:
sequence_len: 2048 sequence_len: 2048
max_packed_sequence_len: 2048
lora_r: 16 lora_r: 16
lora_alpha: 32 lora_alpha: 32
lora_dropout: 0.05 lora_dropout: 0.05