tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Update src/axolotl/monkeypatch/llama_attn_hijack_xformers.py

Browse Source 
Co-authored-by: NanoCode012 <kevinvong@rocketmail.com>
This commit is contained in:
Wing Lian
2023-05-31 00:00:19 -04:00
committed by GitHub
parent 2daa6835f0
commit 1076bcbbca
1 changed files with 0 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
src/axolotl/monkeypatch/llama_attn_hijack_xformers.py
View File

@@ -18,7 +18,6 @@ except ImportError:
def hijack_llama_attention():
transformers.models.llama.modeling_llama.LlamaAttention.forward = xformers_forward
logging.info("Replaced attention with xformers_attention")
def hijack_llama_sdp_attention():