tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Update tiny-llama qlora.yml addressing eval packing error (#1638)

Browse Source
This commit is contained in:
Jaydeep Thik
2024-05-22 08:34:06 -04:00
committed by GitHub
parent a27d5e1f4e
commit 84bb8061ba
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
examples/tiny-llama/qlora.yml
View File

@@ -18,6 +18,7 @@ lora_model_dir:
sequence_len: 4096 sequence_len: 4096
sample_packing: true sample_packing: true
eval_sample_packing: false
pad_to_sequence_len: true pad_to_sequence_len: true
lora_r: 32 lora_r: 32