Wing Lian b7ec06b8a1 Add optional Axolotl MoRA/ReMoRA integration (#3647) [skip ci] ...

* Add optional Axolotl MoRA/ReMoRA integration

Co-authored-by: Axolotl Swarm <no-reply@axolotl.ai>

* Isolate MoRA adapter behavior in plugin

Co-authored-by: Axolotl Swarm <no-reply@axolotl.ai>

* Constrain MoRA variants to supported enum values

* Keep MoRA validation out of core config

---------

Co-authored-by: Swarm <swarm@localhost>
Co-authored-by: Axolotl Swarm <no-reply@axolotl.ai>

2026-05-12 07:19:55 -04:00

..

mora

Add optional Axolotl MoRA/ReMoRA integration (#3647) [skip ci]

2026-05-12 07:19:55 -04:00

__init__.py

upgrade liger to 0.4.0 (#1973)

2024-11-07 12:53:34 -05:00

test_adapter_plugin_registry.py

Add optional Axolotl MoRA/ReMoRA integration (#3647) [skip ci]

2026-05-12 07:19:55 -04:00

test_diffusion_callback.py

roundup_power2_divisions not needed with newer pytorch versions (#3540)

2026-03-24 15:40:05 -04:00

test_diffusion.py

roundup_power2_divisions not needed with newer pytorch versions (#3540)

2026-03-24 15:40:05 -04:00

test_gemma4_moe.py

gemma4 support (#3574)

2026-04-02 17:46:46 -04:00

test_kd_chat_template.py

fix: Fix evaluation loss in KD trainer (#3271)

2025-12-17 13:40:36 -05:00

test_liger.py

feat: add arg to enable dft in liger (#3125)

2025-11-10 21:37:47 +07:00

test_nemo_gym.py

fix async prefetch with nemogym (#3606)

2026-04-22 09:05:46 -04:00

test_routing_parity.py

feat: add sonicmoe fused lora support (#3519)

2026-04-02 08:53:48 -04:00

test_scattermoe_autotune_telemetry.py

fix for flaky tests in lora ops kernels w autotune (#3511) [skip ci]

2026-03-19 01:18:47 -04:00

test_scattermoe_lora_kernels.py

Scattermoe LoRA optimizations (#3513)

2026-03-19 23:07:42 -04:00

test_scattermoe_lora.py

consolidate behavioud of routing in scattermoe kernels (#3475)

2026-03-16 23:47:40 -04:00

test_sonicmoe_gradients.py

feat: add sonicmoe fused lora support (#3519)

2026-04-02 08:53:48 -04:00

test_sonicmoe_lora.py

feat: add sonicmoe fused lora support (#3519)

2026-04-02 08:53:48 -04:00

test_sonicmoe.py

feat: add sonicmoe fused lora support (#3519)

2026-04-02 08:53:48 -04:00

test_swanlab.py

roundup_power2_divisions not needed with newer pytorch versions (#3540)

2026-03-24 15:40:05 -04:00