tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

Fix generation_config validation raises Exception for do_merge_lora (#1184)

Browse Source
This commit is contained in:
Agung Baptiso Sorlawan
2024-01-24 12:42:15 +07:00
committed by GitHub
parent 71141deb18
commit 02f2c720fc
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
src/axolotl/cli/__init__.py
View File

@@ -82,6 +82,7 @@ def do_merge_lora(
model.to(dtype=cfg.torch_dtype) model.to(dtype=cfg.torch_dtype)
except RuntimeError: except RuntimeError:
pass pass
model.generation_config.do_sample = True
if cfg.local_rank == 0: if cfg.local_rank == 0:
LOG.info(f"saving merged model to: {str(Path(cfg.output_dir) / 'merged')}") LOG.info(f"saving merged model to: {str(Path(cfg.output_dir) / 'merged')}")