Wing Lian cd079b5536 Tensor parallel w DeepSpeed AutoTP (#2574) ...

* support for deepspeed autotup

* bump to latest deepspeed that supports deepcompile too

* add deepcompile support too

* fix total steps calculation for TP

* setup fixture for tp

* update ds config to ensure weights are gathered for checkpoint

* fix duplicate validation names

* chore: lint

2025-07-14 21:33:48 -04:00

..

chat

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

test_builders.py

Tensor parallel w DeepSpeed AutoTP (#2574)

2025-07-14 21:33:48 -04:00