Wing Lian b7ec06b8a1 Add optional Axolotl MoRA/ReMoRA integration (#3647) [skip ci] ...

* Add optional Axolotl MoRA/ReMoRA integration

Co-authored-by: Axolotl Swarm <no-reply@axolotl.ai>

* Isolate MoRA adapter behavior in plugin

Co-authored-by: Axolotl Swarm <no-reply@axolotl.ai>

* Constrain MoRA variants to supported enum values

* Keep MoRA validation out of core config

---------

Co-authored-by: Swarm <swarm@localhost>
Co-authored-by: Axolotl Swarm <no-reply@axolotl.ai>

2026-05-12 07:19:55 -04:00

..

cli

Refactor separate attention flags with attn_implementation and capability/concerns feature flags (#3602)

2026-05-05 10:15:18 -04:00

common

super nemo support (#3508)

2026-03-30 18:12:50 -04:00

core

Fix Axolotl ReLoRA optimizer reset scope (#3646)

2026-05-09 17:52:35 -04:00

integrations

Add optional Axolotl MoRA/ReMoRA integration (#3647) [skip ci]

2026-05-12 07:19:55 -04:00

kernels

fix async prefetch with nemogym (#3606)

2026-04-22 09:05:46 -04:00

loaders

Add optional Axolotl MoRA/ReMoRA integration (#3647) [skip ci]

2026-05-12 07:19:55 -04:00

models

Fix: quantize and target moe layers in transformers v5 for adapters and many misc fixes (#3439)

2026-03-03 10:06:23 -05:00

monkeypatch

Fix Axolotl ReLoRA optimizer reset scope (#3646)

2026-05-09 17:52:35 -04:00

prompt_strategies

Feat: add support for datasets with str saved messages field (#3607)

2026-04-23 00:25:48 -04:00

scripts

fix async prefetch with nemogym (#3606)

2026-04-22 09:05:46 -04:00

telemetry

Fix DO_NOT_TRACK not being correctly handled (#3580)

2026-04-04 05:16:58 -04:00

utils

Add optional Axolotl MoRA/ReMoRA integration (#3647) [skip ci]

2026-05-12 07:19:55 -04:00

__init__.py

Version dev (#3365)

2026-01-20 22:58:29 -05:00

convert.py

fix: fix CONTRIBUTING.md placeholders, bare except clauses, and add convert.py tests (#3485) [skip ci]

2026-03-16 00:12:40 -04:00

datasets.py

Streaming SFT support (#3101)

2025-09-02 12:08:44 -04:00

evaluate.py

feat: Add opt-out Telemetry (#3237)

2025-11-18 11:35:25 +07:00

logging_config.py

Debug log, logging improvements (#3159)

2025-09-17 13:27:03 -04:00

processing_strategies.py

feat: systemic multimodal assistant-only loss masking + cfg.role_boundaries` (#3625)

2026-05-05 11:25:39 -04:00

prompt_tokenizers.py

Streaming SFT support (#3101)

2025-09-02 12:08:44 -04:00

prompters.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

train.py

Add optional Axolotl MoRA/ReMoRA integration (#3647) [skip ci]

2026-05-12 07:19:55 -04:00