tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

fix(config): missing config not being documented and fix model_ override (#2317)

Browse Source 
* fix(config): missing config not being documented and fix model_ space override

* fix: delete redundant field
This commit is contained in:
NanoCode012
2025-02-08 18:01:48 +07:00
committed by GitHub
parent fd8cb32547
commit 526e5ee8b8
3 changed files with 9 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/config.qmd
View File

@@ -46,6 +46,10 @@ overrides_of_model_config:
type: # linear | dynamic
factor: # float
# optional overrides the base model loading from_pretrained
overrides_of_model_kwargs:
# use_cache: False
# optional overrides to the bnb 4bit quantization configuration
# https://huggingface.co/docs/transformers/main/main_classes/quantization#transformers.BitsAndBytesConfig
bnb_config_kwargs: