Ben Redmond 22ae21a6c2 Add KTO support (#1640) ...

* add kto support

* test cleanup

* fix outdated comment

* fix llama3 ultra

* chore: lint

* update to use rl_beta instead of dpo_beta

---------

Co-authored-by: Wing Lian <wing.lian@gmail.com>

2024-05-20 16:05:16 -04:00

35 KiB

Raw Permalink Blame History

View Raw