tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

fix(readme): Clarify doc for tokenizer_config (#1323) [skip ci]

Browse Source
This commit is contained in:
NanoCode012
2024-02-24 21:55:04 +09:00
committed by GitHub
parent a359579371
commit 2ed52bd568
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@@ -518,7 +518,7 @@ base_model_ignore_patterns:
base_model_config: ./llama-7b-hf base_model_config: ./llama-7b-hf
# You can specify to choose a specific model revision from huggingface hub # You can specify to choose a specific model revision from huggingface hub
model_revision: model_revision:
# Optional tokenizer configuration override in case you want to use a different tokenizer # Optional tokenizer configuration path in case you want to use a different tokenizer
# than the one defined in the base model # than the one defined in the base model
tokenizer_config: tokenizer_config:
# If you want to specify the type of model to load, AutoModelForCausalLM is a good choice too # If you want to specify the type of model to load, AutoModelForCausalLM is a good choice too