4 Commits

Author	SHA1	Message	Date
Wing Lian	da0d581a8c	add liger example (#1864)	2024-08-23 12:37:50 -04:00
Wing Lian	e4063d60a7	bump transformers and set roundup_power2_divisions for more VRAM improvements, low bit ao optimizers (#1769) ... * bump transformers and set roundup_power2_divisions for more VRAM improvements * support for low bit optimizers from torch ao * fix check for alternate optimizers and use nous models on hf for llama3 * add missing check for ao_adamw_fp8 * fix check when using custom optimizers w adamw	2024-07-19 00:47:07 -04:00
Wing Lian	4fde300e5f	update outputs path so that we can mount workspace to /workspace/data (#1623) ... * update outputs path so that we can mount workspace to /workspace/data * fix ln order	2024-05-15 12:44:13 -04:00
Wing Lian	15f7910d33	llama-3 examples (#1537)	2024-04-18 14:28:03 -04:00