2 Commits

Author	SHA1	Message	Date
NanoCode012	e3177c3210	feat: add complete optimizer docs (#3017) [skip ci] ... * feat: add complete optimizer docs * fix: deprecate old torchao adamw low bit	2025-08-06 08:01:51 -04:00
Wing Lian	ab49d16e34	Dion optimizer support (#3014) ... * Add support for Dion optimizer * dion training kwargs * fix var names * no dion 8bit for now * use updated axolotl-contribs-mit for dion optimizer * add smoke test for dion optimizer * add docs * fix typo during edits * fix test to not remove load in 8bit	2025-08-04 16:33:30 -04:00