Wing Lian b3289fd190 feat: LoRA kernel support for bias, dropout, dora, embeddings (#3528) [skip ci] ...

* feat: LoRA kernel support for bias, dropout, dora, embeddings

* chore: lint

* chore: lint

* address PR feedback, add regression tests, add fsdp2 tests for lora kernels

* update tests for new sigs

* update tests now that bias and dropout are supported

2026-03-22 13:53:19 -04:00

..

patched

Distributed/ND-Parallel (#2977)

2025-07-31 15:25:02 -04:00

solo

transformers v5 upgrade (#3272)

2026-01-27 17:08:24 -05:00

__init__.py

Attempt to run multigpu in PR CI for now to ensure it works (#1815) [skip ci]

2024-08-09 11:50:13 -04:00

test_dist_muon_fsdp2.py

Distributed Muon Optimizer (#3264)

2025-12-19 10:43:47 -05:00

test_eval.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_fp8_fsdp2.py

transformers v5 upgrade (#3272)

2026-01-27 17:08:24 -05:00

test_fsdp1.py

upgrade transformers to 5.2.0 and torchao to 0.16.0 (#3407)

2026-02-19 18:27:27 -05:00

test_fsdp2_lora_kernels.py

feat: LoRA kernel support for bias, dropout, dora, embeddings (#3528) [skip ci]

2026-03-22 13:53:19 -04:00

test_fsdp2.py

mark slow tests that are timing out in CI (#3428) [skip ci]

2026-03-02 12:26:30 -05:00

test_gemma3.py

transformers v5 upgrade (#3272)

2026-01-27 17:08:24 -05:00

test_llama.py

transformers v5 upgrade (#3272)

2026-01-27 17:08:24 -05:00

test_locking.py

Data loader refactor (#2707)

2025-06-10 19:53:07 -04:00

test_ray.py

When using Ray use prepare for dataloader fixes (#3198)

2025-10-08 10:43:41 -04:00

test_tp.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00