tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

Workaround to unblock docs build in main (#3055)

Browse Source 
Co-authored-by: Salman Mohammadi <salman.mohammadi@outlook.com>
This commit is contained in:
Wing Lian
2025-08-13 06:39:39 -04:00
committed by GitHub
parent 3d45620008
commit e0a2523a3b
2 changed files with 2 additions and 14 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
TODO.md
View File

@@ -1,10 +0,0 @@
# todo list
- [] Validation of parameters for combinations that won't work
## things that are known not to work
- FSDP offload and gradient_checkpointing - https://github.com/pytorch/pytorch/issues/82203
- adamw_bnb_8bit doesn't play well with FSDP offload

6
src/axolotl/cli/utils/train.py
View File

@@ -67,14 +67,12 @@ def build_command(base_cmd: list[str], options: dict[str, Any]) -> list[str]:
def generate_config_files(config: str, sweep: str | None) -> Iterator[tuple[str, bool]]: def generate_config_files(config: str, sweep: str | None) -> Iterator[tuple[str, bool]]:
""" """
Generate list of configuration files to process. Generate list of configuration files to process. Yields a tuple of the configuration file name and a boolean indicating
whether this is a group of configurations (i.e., a sweep).
Args: Args:
config: Base configuration file config: Base configuration file
sweep: Sweep configuration file sweep: Sweep configuration file
Yields:
Tuple of configuration file name and whether this is a group of configurations
""" """
if not sweep: if not sweep: