add ds zero3 to multigpu biweekly tests (#1900)

* add ds zero3 to multigpu biweekly tests

* fix for upstream api change

* use updated accelerate and fix deepspeed tests

* stringify the Path, and run multigpu tests if the multigpu tests change for a PR

* use correct json rather than yaml

* revert accelerate for deepspeed
This commit is contained in:
Wing Lian
2024-10-13 17:34:37 -04:00
committed by GitHub
parent 68b1369de9
commit ec4272c3a0
2 changed files with 115 additions and 1 deletions

View File

@@ -4,7 +4,7 @@ peft==0.13.2
transformers==4.45.2
tokenizers>=0.20.1
bitsandbytes==0.44.1
accelerate==1.0.0
accelerate==0.34.2
datasets==3.0.1
deepspeed==0.14.4
pydantic==2.6.3