NanoCode012 21388cf615 Fix: lora kernel pre-patch applied despite post-patch not applied (#2772) ...

* fix: do not pre-patch self attention if lora dropout non-zero

* fix: add test to check patch not applied

* fix: test

* fix: test config check

* fix where we check so that tests don't break

* fix: test

---------

Co-authored-by: Wing Lian <wing@axolotl.ai>

2025-06-14 11:54:06 -07:00

..

__init__.py

Activation function Triton kernels, LoRA custom autograd functions (#2324)

2025-02-17 14:23:15 -05:00

test_lora_kernel_patching.py

Fix: lora kernel pre-patch applied despite post-patch not applied (#2772)

2025-06-14 11:54:06 -07:00