4 Commits

Author	SHA1	Message	Date
Wing Lian	af8d257aa2	make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci] ... * make pad_to_sequence_len default to the same value as sample_packing * remove duplicate validation * fix test * update description meta Co-authored-by: NanoCode012 <nano@axolotl.ai> --------- Co-authored-by: NanoCode012 <nano@axolotl.ai>	2025-07-21 11:40:56 -04:00
Wing Lian	36cbe13d18	activation offloading with cuda streams doesn't work with LoRA (#2927)	2025-07-16 11:59:20 -04:00
Wing Lian	e581c15d40	refactor dupes from merge/rebase (#2919) [skip ci]	2025-07-14 10:05:26 -04:00
Wing Lian	af92151a7b	FSDP2 fix validation and add tests (#2910) ... * fix validation and add tests * remove debugging and add more tests * remove migrate_fsdp	2025-07-14 09:25:44 -04:00