tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

update to latest transformers for mixstral support (#929)

Browse Source 
* update to latest transformers for mixstral support

* pin transformers

* fix typo
This commit is contained in:
Wing Lian
2023-12-10 10:32:27 -05:00
committed by GitHub
parent 68b227a7d8
commit 35f9b0f149
2 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
examples/mistral/mixtral.yml
View File

@@ -1,6 +1,7 @@
base_model: DiscoResearch/mixtral-7b-8expert
model_type: MixtralForCausalLM
tokenizer_type: LlamaTokenizer
trust_remote_code: true
load_in_8bit: false
load_in_4bit: true