GRPO fixes (peft) (#2676)

* don't set peft_config on grpo to prevent double peft wrap

* remove overrides needed to support bug

* fix grpo tests

* require more CPU for multigpu to help with torch compile for vllm
This commit is contained in:
Wing Lian
2025-05-16 15:47:03 -04:00
committed by GitHub
parent 6cb07b9d12
commit a27b909c5c
4 changed files with 5 additions and 63 deletions

View File

@@ -70,7 +70,7 @@ def run_cmd(cmd: str, run_folder: str):
image=cicd_image,
gpu=GPU_CONFIG,
timeout=90 * 60,
cpu=8.0,
cpu=16.0,
memory=131072 * N_GPUS,
volumes=VOLUME_CONFIG,
)