Dan Saunders e758343cac FSDP2 + LoRA kernels (#2992) ...

* impl fix

* smoke tests

* patches for fsdp2 + qlora compat

* nit

* working fix

* working fix

* fix merge

* minifying patches; update bnb dep

* renaming; adding tests

* remove duplicate test, add dora guard

* generalize __torch_function__

* revert generalization

* update comments

2025-08-03 20:05:17 -04:00

..

lora_kernels

Ensure device mesh patching is applied (#2842)

2025-06-29 22:16:32 -04:00

__init__.py

attempt to also run e2e tests that needs gpus (#1070)

2024-01-09 21:23:23 -05:00

test_4d_multipack_llama.py

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00

test_activation_checkpointing.py

update dependencies - liger + trl (#2987)

2025-07-31 11:17:17 -04:00

test_cli_integrations.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_fa_xentropy.py

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00

test_falcon_samplepack.py

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00

test_flattening.py

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00

test_fsdp2_qlora.py

FSDP2 + LoRA kernels (#2992)

2025-08-03 20:05:17 -04:00

test_fused_llama.py

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00

test_llama_s2_attention.py

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00

test_lora_llama_multipack.py

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00

test_mistral_samplepack.py

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00

test_mixtral_samplepack.py

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00

test_model_patches.py

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00

test_peft_embeddings.py

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00

test_phi_multipack.py

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00

test_resume.py

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00

test_unsloth_integration.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_unsloth_qlora.py

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00