From 22c562533d0e106601a41b4d048f3ca0119d3d0b Mon Sep 17 00:00:00 2001 From: Sung Ching Liu <22844540+bursteratom@users.noreply.github.com> Date: Thu, 10 Apr 2025 11:33:09 -0400 Subject: [PATCH] Update rlhf.qmd (#2519) Fix typo in command that spawns a vllm server, should be `axolotl vllm-serve` not `axolotl vllm_serve` --- docs/rlhf.qmd | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/rlhf.qmd b/docs/rlhf.qmd index b3adb5937..490d28126 100644 --- a/docs/rlhf.qmd +++ b/docs/rlhf.qmd @@ -530,7 +530,7 @@ trl: ``` ```bash -CUDA_VISIBLE_DEVICES=2,3 axolotl vllm_serve grpo.yaml +CUDA_VISIBLE_DEVICES=2,3 axolotl vllm-serve grpo.yaml ``` Your `vLLM` instance will now attempt to spin up, and it's time to kick off training utilizing our remaining two GPUs. In another terminal, execute: