3 Commits

Author	SHA1	Message	Date
NanoCode012	856ff12171	feat(doc): add optimizations table of content to our improvements (#3175) [skip ci] ... * chore: format * feat: add usage for alst * chore: wording * feat: add optimizations doc * Apply suggestion from @SalmanMohammadi Co-authored-by: salman <salman.mohammadi@outlook.com> * Update docs/dataset-formats/index.qmd Co-authored-by: salman <salman.mohammadi@outlook.com> * feat: add alst, act offloading, nd parallelism, use relative links, and fix format * chore: comments --------- Co-authored-by: salman <salman.mohammadi@outlook.com>	2025-09-24 16:13:49 -04:00
salman	294c7fe7a6	Distributed/ND-Parallel (#2977)	2025-07-31 15:25:02 -04:00
Wing Lian	f7ea140838	TiledMLP support for FSDP2 (#2950) ... * make TiledMLP work with FSDP * cleanup/gc at start of train to prevent large VRAM spike * chore: lint * generic function for non-deepspeed training * unify patch to fix imports * update readme for ALST and add examples * make deepspeed attribute on params check more robust * update with new info from PR review	2025-07-25 07:15:03 -04:00