Commit Graph

4 Commits

Author SHA1 Message Date
Wing Lian
46afcf070f rename to specify fsdp 2025-04-09 02:39:03 -04:00
Wing Lian
3036ca349f add README for llama4 2025-04-09 02:15:09 -04:00
Wing Lian
dc4809f7dd [llama4] fix the mm yaml, add scout single gpu yaml 2025-04-09 01:52:31 -04:00
Wing Lian
0dac2ddeac Llama4 linearized (#2502)
* llama4 support for linearized experts

* clean up fsdp2 sharding to prevent hang

* add yaml config

* cleanup example [skip ci]
2025-04-07 20:47:00 -04:00