Merge branch 'main' into destroy-pg

ray bugfix
update
2025-03-31 14:36:43 -04:00 · 2025-03-31 18:35:41 +00:00 · 2025-03-31 14:46:15 +00:00 · 2025-03-31 14:32:50 +00:00
1 changed files with 2 additions and 1 deletions
--- a/src/axolotl/train.py
+++ b/src/axolotl/train.py
@@ -509,6 +509,7 @@ def train(
    # Save the trained model and cleanup
    save_trained_model(cfg, trainer, model, safe_serialization)
    create_model_card(cfg, trainer)
+    if not cfg.use_ray:
        cleanup_distributed()

    return model, tokenizer, trainer
Author	SHA1	Message	Date
Dan Saunders	1defb8a955	Merge branch 'main' into destroy-pg	2025-03-31 14:36:43 -04:00
Dan Saunders	70b466aa67	ray bugfix	2025-03-31 18:35:41 +00:00
Dan Saunders	32ce167404	update	2025-03-31 14:46:15 +00:00
Dan Saunders	1c4cc639f5	fix nccl pg destroy warning	2025-03-31 14:32:50 +00:00