Wing Lian cd079b5536 Tensor parallel w DeepSpeed AutoTP (#2574) ...

* support for deepspeed autotup

* bump to latest deepspeed that supports deepcompile too

* add deepcompile support too

* fix total steps calculation for TP

* setup fixture for tp

* update ds config to ensure weights are gathered for checkpoint

* fix duplicate validation names

* chore: lint

2025-07-14 21:33:48 -04:00

5.8 KiB

Raw Blame History

View Raw