From d25c34caa6f324cdd7521138f4515e6ed7dc258d Mon Sep 17 00:00:00 2001 From: Ikko Eltociear Ashimine Date: Sun, 17 Dec 2023 23:51:25 +0900 Subject: [PATCH] Update README.md (#966) --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index c03eec54b..f0e399ace 100644 --- a/README.md +++ b/README.md @@ -981,7 +981,7 @@ wandb_log_model: ##### Special Tokens -It is important to have special tokens like delimiters, end-of-sequence, beginning-of-sequence in your tokenizer's vocubulary. This will help you avoid tokenization issues and help your model train better. You can do this in axolotl like this: +It is important to have special tokens like delimiters, end-of-sequence, beginning-of-sequence in your tokenizer's vocabulary. This will help you avoid tokenization issues and help your model train better. You can do this in axolotl like this: ```yml special_tokens: