tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

update to latest transformers for mixstral support (#929)

Browse Source 
* update to latest transformers for mixstral support

* pin transformers

* fix typo
This commit is contained in:
Wing Lian
2023-12-10 10:32:27 -05:00
committed by GitHub
parent 68b227a7d8
commit 35f9b0f149
2 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
examples/mistral/mixtral.yml
View File

@@ -1,6 +1,7 @@
base_model: DiscoResearch/mixtral-7b-8expert base_model: DiscoResearch/mixtral-7b-8expert
model_type: MixtralForCausalLM model_type: MixtralForCausalLM
tokenizer_type: LlamaTokenizer tokenizer_type: LlamaTokenizer
trust_remote_code: true
load_in_8bit: false load_in_8bit: false
load_in_4bit: true load_in_4bit: true

2
requirements.txt
View File

@@ -2,7 +2,7 @@
auto-gptq==0.5.1 auto-gptq==0.5.1
packaging packaging
peft==0.6.0 peft==0.6.0
transformers==4.35.2 transformers @ git+https://github.com/huggingface/transformers.git@df5c5c62ae253055336f5bb0828ca8e3e15ab6bd
tokenizers==0.15.0 tokenizers==0.15.0
bitsandbytes>=0.41.1 bitsandbytes>=0.41.1
accelerate==0.24.1 accelerate==0.24.1