bartch upgrade dependencies (#3299)

* upgrade dependencies

* don't use reset sessions

* downgrade transformers, upgrade other deps

* upgrade bnb to 0.49.0

* restore s3 cache

* explicit use local files w hub

* decompress and strip top level dir

* use 2 levels for strip components

* try to preserve permissions for symlinks

* use updated tar

* fix #3293 for distributed

* downgrade bnb

* fast fail after 4

* fix total tokens device

* patch accelerate CP/SP (#3309)

---------

Co-authored-by: salman <salman.mohammadi@outlook.com>
This commit is contained in:
Wing Lian
2025-12-30 09:02:49 -05:00
committed by GitHub
parent 66a3de3629
commit 11c0b5b256
9 changed files with 66 additions and 26 deletions

View File

@@ -14,12 +14,12 @@ huggingface_hub>=0.36.0
peft>=0.18.0
tokenizers>=0.22.1
transformers==4.57.1
accelerate==1.11.0
datasets==4.4.1
deepspeed>=0.17.0
trl==0.25.0
accelerate==1.12.0
datasets==4.4.2
deepspeed>=0.18.3
trl==0.25.1
hf_xet==1.2.0
kernels>=0.9.0
kernels==0.11.5
trackio>=0.13.0
typing_extensions>=4.14.0