Dan Saunders 59cd472504 SP cu_seqlens fix, refactor (#2495) ...

* working on masking fix

* refactor and fix multipack seqlens

* pre-commit fix

* adding smoke test

* using existing packed seqlens util

* log warning re: logged losses / gradient scaling per rank

2025-04-07 14:47:57 -04:00

2.8 KiB

Raw Permalink Blame History

View Raw