tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Liger Kernel integration (#1861)

Browse Source 
* add initial plugin support w Liger kernel patches

* integrate the input args classes

* fix liger plugin and dynamic configuration class

* drop untrainable samples and refactor config plugins integration

* fix incorrect inputs and circular imports

* fix bool comparison

* fix for dropping untraibable tokens

* fix licensing so liger integration is Apache 2.0

* add jamba support

* pylint ignore
This commit is contained in:
Wing Lian
2024-08-23 12:21:51 -04:00
committed by GitHub
parent e8ff5d5738
commit 1f686c576c
12 changed files with 1010 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
.mypy.ini
View File

@@ -11,6 +11,9 @@ ignore_errors = True
[mypy-axolotl.models.mixtral.*]
ignore_errors = True
[mypy-axolotl.integrations.liger.models.*]
ignore_errors = True
[mypy-axolotl.models.phi.*]
ignore_errors = True