Wing Lian 78e12f8ca5 add basic support for the optimi adamw optimizer (#1727) ...

* add support for optimi_adamw optimizer w kahan summation

* pydantic validator for optimi_adamw

* workaround for setting optimizer for fsdp

* make sure to install optimizer packages

* make sure to have parity for model parameters passed to optimizer

* add smoke test for optimi_adamw optimizer

* don't use foreach optimi by default

2024-07-14 19:12:57 -04:00

..

Dockerfile

add basic support for the optimi adamw optimizer (#1727)

2024-07-14 19:12:57 -04:00

Dockerfile-base

deprecate py 3.9 support, set min pytorch version (#1343) [skip ci]

2024-02-28 12:58:05 -05:00

Dockerfile-cloud

fix symlinks for axolotl outputs (#1625)

2024-05-15 19:41:45 -04:00

Dockerfile-cloud-no-tmux

fix ray install (#1630)

2024-05-16 01:25:42 -04:00

Dockerfile-tests

github urls (#1734)

2024-07-11 09:19:29 -04:00