Wing Lian 68f1b7004c ScatterMoE LoRA support (#3410) ...

* scattermoe lora support

* fsdp, bf16, dim fixes

* expert weights aren't needed in save for bwd since they are frozen

* use sonicmoe optim options

* update save model from upstream

* fixes per code review feedback and add tests

* revert removal of CP fix

* misc fixes

2026-02-24 14:59:55 -05:00

..

__init__.py

upgrade liger to 0.4.0 (#1973)

2024-11-07 12:53:34 -05:00

test_diffusion_callback.py

text diffusion training plugin (#3067)

2025-09-10 20:27:00 -04:00

test_diffusion.py

text diffusion training plugin (#3067)

2025-09-10 20:27:00 -04:00

test_kd_chat_template.py

fix: Fix evaluation loss in KD trainer (#3271)

2025-12-17 13:40:36 -05:00

test_liger.py

feat: add arg to enable dft in liger (#3125)

2025-11-10 21:37:47 +07:00

test_scattermoe_lora.py

ScatterMoE LoRA support (#3410)

2026-02-24 14:59:55 -05:00

test_swanlab.py

feat: Add SwanLab integration for experiment tracking (#3334)

2026-01-06 09:19:18 -05:00