tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

fix config for parity with previous change

Browse Source 
5159d00a86\#diff-65b4693504c4e8ffac76c7f2c90913faee381f802cf64e7f49c995a2134ed3b3R164
This commit is contained in:
Wing Lian
2023-05-11 08:13:09 -04:00
parent 4cc7ed8898
commit 165da584b3
6 changed files with 8 additions and 9 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/redpajama/config-3b.yml
View File

@@ -52,7 +52,7 @@ deepspeed:
weight_decay: 0.0001
fsdp:
fsdp_config:
special_tokens:
tokens:
pad_token: "<|padding|>"
bos_token: "<|endoftext|>"
eos_token: "<|endoftext|>"