update datasets version to cut down the warnings due to pyarrow arg change (#897)

* update datasets to cut down the warnings

* set versions for tokenizers and gradio

* upgrade transformers to latest version
This commit is contained in:
Wing Lian
2023-11-25 16:30:00 -05:00
committed by GitHub
parent 1115c501b8
commit 6a4562ac08

View File

@@ -2,14 +2,15 @@
auto-gptq==0.5.1 auto-gptq==0.5.1
packaging packaging
peft==0.6.0 peft==0.6.0
transformers==4.35.1 transformers==4.35.2
tokenizers==0.15.0
bitsandbytes>=0.41.1 bitsandbytes>=0.41.1
accelerate==0.24.1 accelerate==0.24.1
deepspeed deepspeed
addict addict
fire fire
PyYAML>=6.0 PyYAML>=6.0
datasets>=2.14.0 datasets>=2.15.0
flash-attn==2.3.3 flash-attn==2.3.3
sentencepiece sentencepiece
wandb wandb
@@ -29,7 +30,7 @@ scikit-learn==1.2.2
pynvml pynvml
art art
fschat==0.2.29 fschat==0.2.29
gradio gradio==3.50.2
tensorboard tensorboard
# remote filesystems # remote filesystems