diff --git a/docs/rlhf.qmd b/docs/rlhf.qmd index af3fe8767..b2687a8f9 100644 --- a/docs/rlhf.qmd +++ b/docs/rlhf.qmd @@ -16,7 +16,7 @@ feedback. Various methods include, but not limited to: - [Identity Preference Optimization (IPO)](#ipo) - [Kahneman-Tversky Optimization (KTO)](#kto) - [Odds Ratio Preference Optimization (ORPO)](#orpo) -- [Group Relative Policy Optimization (GPRO)](#grpo) +- [Group Relative Policy Optimization (GRPO)](#grpo) - Proximal Policy Optimization (PPO) (not yet supported in axolotl, if you're interested in contributing, please reach out!)