Wing Lian ab49d16e34 Dion optimizer support (#3014) ...

* Add support for Dion optimizer

* dion training kwargs

* fix var names

* no dion 8bit for now

* use updated axolotl-contribs-mit for dion optimizer

* add smoke test for dion optimizer

* add docs

* fix typo during edits

* fix test to not remove load in 8bit

2025-08-04 16:33:30 -04:00

9.6 KiB

Raw Blame History

View Raw