4 Commits

Author	SHA1	Message	Date
Wing Lian	46afcf070f	rename to specify fsdp	2025-04-09 02:39:03 -04:00
Wing Lian	3036ca349f	add README for llama4	2025-04-09 02:15:09 -04:00
Wing Lian	dc4809f7dd	[llama4] fix the mm yaml, add scout single gpu yaml	2025-04-09 01:52:31 -04:00
Wing Lian	0dac2ddeac	Llama4 linearized (#2502) ... * llama4 support for linearized experts * clean up fsdp2 sharding to prevent hang * add yaml config * cleanup example [skip ci]	2025-04-07 20:47:00 -04:00