2 Commits

Author	SHA1	Message	Date
salman	294c7fe7a6	Distributed/ND-Parallel (#2977)	2025-07-31 15:25:02 -04:00
Wing Lian	f7ea140838	TiledMLP support for FSDP2 (#2950) ... * make TiledMLP work with FSDP * cleanup/gc at start of train to prevent large VRAM spike * chore: lint * generic function for non-deepspeed training * unify patch to fix imports * update readme for ALST and add examples * make deepspeed attribute on params check more robust * update with new info from PR review	2025-07-25 07:15:03 -04:00