Wing Lian 2147cf6837 Llama3 dpo (#1610) ...

* add dpo llama3

* fix dpo bos and eos

* bos token gets added automatically by the tokenizer

* explicit <|end_of_text|> not needed, as eot_id is sufficient

---------

Co-authored-by: Nero10578 <owenarliawan@gmail.com>

2024-05-11 18:29:03 -04:00

..

axolotl

Llama3 dpo (#1610)

2024-05-11 18:29:03 -04:00