tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

latest HEAD of accelerate causes 0 loss immediately w FSDP (#321)

Browse Source
This commit is contained in:
Wing Lian
2023-07-24 11:23:56 -04:00
committed by GitHub
parent 3d4984b9a5
commit 9f69c4d8c1
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
requirements.txt
View File

@@ -1,7 +1,7 @@
peft @ git+https://github.com/huggingface/peft.git
transformers @ git+https://github.com/huggingface/transformers.git
bitsandbytes>=0.39.0
accelerate @ git+https://github.com/huggingface/accelerate
accelerate==0.21.0
addict
fire
PyYAML==6.0