Wing Lian 887513285d support for custom lr groups for non-embedding modules (#2213) ...

* support for custom lr groups for non-embedding modules

invert name check for group modules
include lr_groups in training args
additional conditional for creating optimizer
fix regular params as w weight decay
fix lookup and add docs

* address pr feedback

2025-01-24 12:56:28 -05:00

738 B

Raw Blame History

View Raw