tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Update src/axolotl/monkeypatch/llama_attn_hijack_xformers.py

Browse Source 
Co-authored-by: NanoCode012 <kevinvong@rocketmail.com>
This commit is contained in:
Wing Lian
2023-05-30 23:59:05 -04:00
committed by GitHub
parent ad0ea6aaab
commit 2daa6835f0
1 changed files with 0 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
src/axolotl/monkeypatch/llama_attn_hijack_xformers.py
View File

@@ -25,7 +25,6 @@ def hijack_llama_sdp_attention():
transformers.models.llama.modeling_llama.LlamaAttention.forward = ( transformers.models.llama.modeling_llama.LlamaAttention.forward = (
sdp_attention_forward sdp_attention_forward
) )
logging.info("Replaced attention with sdp_attention")
def xformers_forward( def xformers_forward(