tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

upgrade trl==0.19.1 (#2892) [skip ci]

Browse Source 
* upgrade trl==0.19.1

* add vllm for tests for grpo

* fixes to work with latest trl

* need data_parallel_size config too

* support for vllm_mode for server / colocate

* vllm settings for colocate

* relax vllm version

* bump min hf hub for latest vllm support

* add hints on string literal for vllm mode

* use latest transformers 4.53.2

* tweak acceptable loss on flaky test_ds_zero3_packed test

* don't run flaky vllm/grpo tests for now
This commit is contained in:
Wing Lian
2025-07-14 09:23:42 -04:00
committed by GitHub
parent 41664c7c4c
commit 5081db7f8a
9 changed files with 43 additions and 42 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
requirements.txt
View File

@@ -11,14 +11,14 @@ liger-kernel==0.5.10
packaging==23.2
huggingface_hub==0.32.2
huggingface_hub>=0.33.0
peft==0.15.2
transformers==4.53.1
transformers==4.53.2
tokenizers>=0.21.1
accelerate==1.8.1
datasets==3.6.0
deepspeed>=0.17.0
trl==0.18.2
trl==0.19.1
hf_xet==1.1.2
optimum==1.16.2