axolotl

Files

salman bbd3486f57 Distributed Muon Optimizer (#3264 )

* init

* working

* updating configs

* removing unneeded files

* lint

* comments

* lint

* fix regex match

* bump contribs version

* comments

* fixing tests and imports

* muon imports in test v2

* test cleanup

* bump contribs version

---------

Co-authored-by: Salman Mohammadi <“salman.mohammadi@outlook.com”>

2025-12-19 10:43:47 -05:00

adamw-pretrain-fsdp2.yaml

Distributed Muon Optimizer (#3264 )

2025-12-19 10:43:47 -05:00

dpo.yaml

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

muon-pretrain-fsdp2.yaml

Distributed Muon Optimizer (#3264 )

2025-12-19 10:43:47 -05:00

prm.yaml

make pad_to_sequence_len default to the same value as sample_packing (#2941 ) [skip ci]