3 Commits

Author	SHA1	Message	Date
Wing Lian	bd2a594b89	use DataCollatorWithFlattening when not sample packing (#2167)	2024-12-17 17:46:44 -05:00
Wing Lian	e246ceffa4	use axolotl contribs for fix_untrained_tokens (#2194) [skip ci] ... * use axolotl contribs for fix_untrained_tokens * remove the module we're replacing * Add check for using fix_untrained_tokens	2024-12-17 13:57:16 -05:00
Chirag Jain	0c8b1d824a	Update get_unpad_data patching for multipack (#2013) ... * Update `get_unpad_data` patching for multipack * Update src/axolotl/utils/models.py * Update src/axolotl/utils/models.py * Add test case --------- Co-authored-by: Wing Lian <wing.lian@gmail.com> Co-authored-by: Wing Lian <wing@axolotl.ai>	2024-11-15 20:35:50 -05:00