tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Check torch version for ADOPT optimizer + integrating new ADOPT updates (#2104)

Browse Source 
* added torch check for adopt, wip

* lint

* gonna put torch version checking somewhere else

* added ENVcapabilities class for torch version checking

* lint + pydantic

* ENVCapabilities -> EnvCapabilities

* forgot to git add v0_4_1/__init__.py

* removed redundancy

* add check if env_capabilities not specified

* make env_capabilities compulsory [skip e2e]

* fixup env_capabilities

* modified test_validation.py to accomodate env_capabilities

* adopt torch version test [skip e2e]

* raise error

* test correct torch version

* test torch version above requirement

* Update src/axolotl/utils/config/models/input/v0_4_1/__init__.py

Co-authored-by: Wing Lian <wing.lian@gmail.com>

* removed unused is_totch_min

---------

Co-authored-by: Wing Lian <wing@axolotl.ai>
Co-authored-by: Wing Lian <wing.lian@gmail.com>
This commit is contained in:
Sunny Liu
2024-12-02 20:15:39 -05:00
committed by GitHub
parent 9f6d0b5587
commit d5f58b6509
10 changed files with 189 additions and 66 deletions
Download Patch File Download Diff File Expand all files Collapse all files

12
tests/test_validation_dataset.py
View File

@@ -72,6 +72,9 @@ class TestValidationCheckDatasetConfig(BaseValidation):
"n_gpu": 1,
"compute_capability": "8.0",
},
env_capabilities={
"torch_version": "2.5.1",
},
)
_check_config()
@@ -124,6 +127,9 @@ class TestValidationCheckDatasetConfig(BaseValidation):
"n_gpu": 1,
"compute_capability": "8.0",
},
env_capabilities={
"torch_version": "2.5.1",
},
)
_check_config()
@@ -177,6 +183,9 @@ class TestValidationCheckDatasetConfig(BaseValidation):
"n_gpu": 1,
"compute_capability": "8.0",
},
env_capabilities={
"torch_version": "2.5.1",
},
)
_check_config()
@@ -231,6 +240,9 @@ class TestValidationCheckDatasetConfig(BaseValidation):
"n_gpu": 1,
"compute_capability": "8.0",
},
env_capabilities={
"torch_version": "2.5.1",
},
)
_check_config()