Avaya Aggarwal 7ddfb2d8a0 cleanup: remove dead SDPA patches (#3488) [skip ci] ...

Transformers 5.x routes attention through sdpa_attention.py and no longer
calls the _prepare_4d_causal_attention_mask* or _expand_mask functions that
these patches targeted. This makes the following patches dead code:

- llama_patch_multipack.py (patched _prepare_4d_causal_attention_mask*)
- llama_expand_mask.py (patched _expand_mask, never called)
- Related utility functions in monkeypatch/utils.py

Closes axolotl-ai-cloud/axolotl#3331

2026-03-20 17:10:41 +07:00

11 KiB

Raw Blame History

View Raw