tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

Update README.md (#966)

Browse Source
This commit is contained in:
Ikko Eltociear Ashimine
2023-12-17 23:51:25 +09:00
committed by GitHub
parent 13e938149d
commit d25c34caa6
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@@ -981,7 +981,7 @@ wandb_log_model:
##### Special Tokens ##### Special Tokens
It is important to have special tokens like delimiters, end-of-sequence, beginning-of-sequence in your tokenizer's vocubulary. This will help you avoid tokenization issues and help your model train better. You can do this in axolotl like this: It is important to have special tokens like delimiters, end-of-sequence, beginning-of-sequence in your tokenizer's vocabulary. This will help you avoid tokenization issues and help your model train better. You can do this in axolotl like this:
```yml ```yml
special_tokens: special_tokens: