tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

update to latest transformers for mixstral support (#929)

Browse Source 
* update to latest transformers for mixstral support

* pin transformers

* fix typo
This commit is contained in:
Wing Lian
2023-12-10 10:32:27 -05:00
committed by GitHub
parent 68b227a7d8
commit 35f9b0f149
2 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
examples/mistral/mixtral.yml
View File

@@ -1,6 +1,7 @@
base_model: DiscoResearch/mixtral-7b-8expert
model_type: MixtralForCausalLM
tokenizer_type: LlamaTokenizer
trust_remote_code: true
load_in_8bit: false
load_in_4bit: true

2
requirements.txt
View File

@@ -2,7 +2,7 @@
auto-gptq==0.5.1
packaging
peft==0.6.0
transformers==4.35.2
transformers @ git+https://github.com/huggingface/transformers.git@df5c5c62ae253055336f5bb0828ca8e3e15ab6bd
tokenizers==0.15.0
bitsandbytes>=0.41.1
accelerate==0.24.1