Wing Lian a27b909c5c GRPO fixes (peft) (#2676) ...

* don't set peft_config on grpo to prevent double peft wrap

* remove overrides needed to support bug

* fix grpo tests

* require more CPU for multigpu to help with torch compile for vllm

2025-05-16 15:47:03 -04:00

..

__init__.py

make sure to download fixtures for kd test (#2541)

2025-04-21 10:31:50 -04:00

test_flex.py

make sure to download fixtures for kd test (#2541)

2025-04-21 10:31:50 -04:00

test_grpo.py

GRPO fixes (peft) (#2676)

2025-05-16 15:47:03 -04:00