tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Fix pydantic configuration for the max_memory input (#1385) [skip ci]

Browse Source 
* Fix pydantic configuration for the max_memory input

* chore: lint

---------

Co-authored-by: Wing Lian <wing.lian@gmail.com>
This commit is contained in:
David Baker
2024-03-11 00:50:04 +00:00
committed by GitHub
parent 7659c001aa
commit 0bc114d2e1
1 changed files with 3 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
src/axolotl/utils/config/models/input/v0_4_1/__init__.py
View File

@@ -512,7 +512,9 @@ class AxolotlInputConfig(
neftune_noise_alpha: Optional[float] = None
max_memory: Optional[Union[int, str]] = None
max_memory: Optional[
Dict[Union[int, Literal["cpu", "disk"]], Union[int, str]]
] = None
gpu_memory_limit: Optional[Union[int, str]] = None
chat_template: Optional[Union[Literal["chatml", "inst"], ChatTemplate]] = None