tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Update instruct-lora-8b.yml (#1789) [skip ci]

Browse Source 
Config is giving an error if not using the end of the token as the `pad_to_sequence_len` is true.
This commit is contained in:
Aaditya Ura (looking for PhD Fall’24)
2024-08-05 22:13:20 +05:30
committed by GitHub
parent 7402eb9dcb
commit cb023c70db
1 changed files with 2 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/llama-3/instruct-lora-8b.yml
View File

@@ -74,3 +74,5 @@ deepspeed:
weight_decay: 0.0 weight_decay: 0.0
fsdp: fsdp:
fsdp_config: fsdp_config:
special_tokens:
pad_token: <|end_of_text|>