use axolotl contribs for fix_untrained_tokens (#2194) [skip ci]

* use axolotl contribs for fix_untrained_tokens * remove the module we're replacing * Add check for using fix_untrained_tokens
2024-12-17 13:57:16 -05:00
parent 8ddc18ec8d
commit e246ceffa4
5 changed files with 55 additions and 279 deletions
--- a/requirements.txt
+++ b/requirements.txt
@@ -60,3 +60,5 @@ antlr4-python3-runtime==4.13.2

 torchao==0.7.0
 schedulefree==1.3.0
+
+axolotl-contribs-lgpl==0.0.1b2