Wing Lian 0dac2ddeac Llama4 linearized (#2502) ...

* llama4 support for linearized experts

* clean up fsdp2 sharding to prevent hang

* add yaml config

* cleanup example [skip ci]

2025-04-07 20:47:00 -04:00

..

scout-lora.yaml

Llama4 linearized (#2502)

2025-04-07 20:47:00 -04:00

scout-qlora-fsdp1.yaml

Llama4 linearized (#2502)

2025-04-07 20:47:00 -04:00