bartch upgrade dependencies (#3299)

* upgrade dependencies

* don't use reset sessions

* downgrade transformers, upgrade other deps

* upgrade bnb to 0.49.0

* restore s3 cache

* explicit use local files w hub

* decompress and strip top level dir

* use 2 levels for strip components

* try to preserve permissions for symlinks

* use updated tar

* fix #3293 for distributed

* downgrade bnb

* fast fail after 4

* fix total tokens device

* patch accelerate CP/SP (#3309)

---------

Co-authored-by: salman <salman.mohammadi@outlook.com>
This commit is contained in:
Wing Lian
2025-12-30 09:02:49 -05:00
committed by GitHub
parent 66a3de3629
commit 11c0b5b256
9 changed files with 66 additions and 26 deletions

View File

@@ -62,7 +62,7 @@ def snapshot_download_w_retry(*args, **kwargs):
"""
with hf_offline_context(True):
try:
return snapshot_download(*args, **kwargs)
return snapshot_download(*args, local_files_only=True, **kwargs)
except LocalEntryNotFoundError:
pass
with hf_offline_context(False):