Wing Lian 1dd7f087b3 support for custom lr groups for non-embedding modules ...

invert name check for group modules
include lr_groups in training args
additional conditional for creating optimizer
fix regular params as w weight decay
fix lookup and add docs

2024-12-25 22:36:59 -05:00

..

axolotl

support for custom lr groups for non-embedding modules

2024-12-25 22:36:59 -05:00

setuptools_axolotl_dynamic_dependencies.py

fix build w pyproject to respect insalled torch version (#2168)

2024-12-10 16:25:25 -05:00