tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

update flash attention to 2.5.5 for gemma

Browse Source
This commit is contained in:
Wing Lian
2024-02-21 23:32:44 -05:00
parent a359579371
commit 718a8f4153
2 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
requirements.txt
View File

@@ -11,7 +11,7 @@ fire
PyYAML>=6.0
requests
datasets>=2.15.0
flash-attn==2.3.3
flash-attn==2.5.5
sentencepiece
wandb
einops