Wing Lian 78e12f8ca5 add basic support for the optimi adamw optimizer (#1727) ...

* add support for optimi_adamw optimizer w kahan summation

* pydantic validator for optimi_adamw

* workaround for setting optimizer for fsdp

* make sure to install optimizer packages

* make sure to have parity for model parameters passed to optimizer

* add smoke test for optimi_adamw optimizer

* don't use foreach optimi by default

2024-07-14 19:12:57 -04:00

..

cicd.sh

make sure the CI fails when pytest script fails (#1669)

2024-05-29 10:12:11 -04:00

Dockerfile.jinja

add basic support for the optimi adamw optimizer (#1727)

2024-07-14 19:12:57 -04:00

tests.py

run tests again on Modal (#1289) [skip ci]

2024-02-29 14:26:26 -05:00