5 Commits

Author	SHA1	Message	Date
Dan Saunders	6e72baf287	continued cleanup and documentation	2025-01-13 17:19:02 +00:00
Dan Saunders	6f80d1d670	fix	2025-01-13 17:05:38 +00:00
Wing Lian	dd26cc3c0f	add helper to verify the correct model output file exists (#2245) ... * add helper to verify the correct model output file exists * more checks using helper * chore: lint * fix import and relora model check * workaround for trl trainer saves * remove stray print	2025-01-13 10:43:29 -05:00
Wing Lian	a1790f2652	replace tensorboard checks with helper function (#2120) [skip ci] ... * replace tensorboard checks with helper function * move helper function * use relative	2024-12-03 21:06:20 -05:00
Wing Lian	1cf7075d18	support seperate lr for embeddings, similar to loraplus (#1910) [skip ci] ... * support seperate lr for embeddings, similar to loraplus * add test case for train w lr embedding scale * use kwarg for optimizer * make sure to handle the optimizer creation * make sure to handle for embedding_lr too * use smollm for e2e, check for embeddings lr first before wdecay	2024-11-29 20:38:20 -05:00