Wing Lian 7d1d22f72f ORPO Trainer replacement (#1551) ...

* WIP use trl ORPOTrainer

* fixes to make orpo work with trl

* fix the chat template laoding

* make sure to handle the special tokens and add_generation for assistant turn too

2024-04-19 17:25:36 -04:00

..

test_trainer_builder.py

ORPO Trainer replacement (#1551)

2024-04-19 17:25:36 -04:00