Sunny Liu 3265b7095e Add weighted optimisation support for trl DPO trainer integration (#2016) ...

* trlv0.12.0  integration

* update trl version requirements

* linting

* commenting out

* trl version requirement

2024-11-08 11:29:11 -05:00

901 B

Raw Blame History

View Raw