Dan Saunders e758343cac FSDP2 + LoRA kernels (#2992) ...

* impl fix

* smoke tests

* patches for fsdp2 + qlora compat

* nit

* working fix

* working fix

* fix merge

* minifying patches; update bnb dep

* renaming; adding tests

* remove duplicate test, add dora guard

* generalize __torch_function__

* revert generalization

* update comments

2025-08-03 20:05:17 -04:00

..

patched

Distributed/ND-Parallel (#2977)

2025-07-31 15:25:02 -04:00

solo

Distributed/ND-Parallel (#2977)

2025-07-31 15:25:02 -04:00

__init__.py

Attempt to run multigpu in PR CI for now to ensure it works (#1815) [skip ci]

2024-08-09 11:50:13 -04:00

test_eval.py

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00

test_fp8_fsdp2.py

Distributed/ND-Parallel (#2977)

2025-07-31 15:25:02 -04:00

test_fsdp1.py

FSDP1 -> FSDP2 (#2760)

2025-07-12 15:18:01 +01:00

test_fsdp2.py

FSDP2 + LoRA kernels (#2992)

2025-08-03 20:05:17 -04:00

test_gemma3.py

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00

test_llama.py

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00

test_locking.py

Data loader refactor (#2707)

2025-06-10 19:53:07 -04:00

test_ray.py

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00

test_tp.py

Distributed/ND-Parallel (#2977)

2025-07-31 15:25:02 -04:00