Wing Lian 98333e639a upgrade trl to 0.24.0 and liger to 0.6.3 (#3230) ...

* upgrade trl to 0.24.0

* fix reward collator init

* use newer DataCollatorForPreference instead

* DataCollatorForPreference doesn't use padding kwarg

* fix input id labels

* fix fbgemm-gpu version for pytorch versions

* tweak pinned deps

* transformers doesn't support hub 1.0 yet

* upgrade liger dep to 0.6.3

* set TORCH_CUDA_ARCH_LIST correctly

2025-10-29 18:02:16 -04:00

6.3 KiB

Raw Blame History

View Raw