3 Commits

Author	SHA1	Message	Date
Wing Lian	521e62daf1	remove the bos token from dpo outputs (#1733) [skip ci] ... * remove the bos token from dpo outputs * don't forget to fix prompt_input_ids too * use processing_class instead of tokenizer * fix for processing class	2024-11-15 19:09:20 -05:00
Wing Lian	5b0b774e38	ensure that the bias is also in the correct dtype (#1848) [skip ci] ... * ensure that the bias is also in the correct dtype * add nightly for dpo-qlora-fsdp	2024-08-22 11:45:00 -04:00
Wing Lian	00ac3022a1	add qwen2-72b fsdp example (#1696)	2024-06-07 16:38:29 -04:00