3 Commits

Author	SHA1	Message	Date
Aman Gupta Karmani	1e07c162f1	set zero3 optimizer betas to auto so they inherit from HF trainer config (#507)	2023-08-30 08:10:33 -04:00
mhenrichsen	3fc9006298	Feat(deepspeed): Add zero2 config (#476) ... * zero2 config * config added * linting --------- Co-authored-by: mhenrichsen <some_email@hey.com>	2023-08-27 10:10:33 +09:00
Wing Lian	bb53a165f5	add a basic ds zero3 config (#347) ... better defaults for ds	2023-08-06 17:19:51 -04:00