support galore once upstreamed into transformers (#1409)

* support galore once upstreamed into transformers * update module name for llama in readme and fix typing for all linear * bump trl for deprecation fixes from newer transformers * include galore as an extra and install in docker image * fix optim_args type * fix optim_args * update dependencies for galore * add galore to cicd dockerfile
2024-03-19 09:26:35 -04:00
parent 40a88e8c4a
commit dd449c5cd8
7 changed files with 51 additions and 7 deletions
--- a/setup.py
+++ b/setup.py
@@ -89,5 +89,8 @@ setup(
        "lion-pytorch": [
            "lion-pytorch==0.1.2",
        ],
+        "galore": [
+            "galore_torch",
+        ],
    },
 )