Files
axolotl/tests/e2e/multigpu
Dan Saunders 59cd472504 SP cu_seqlens fix, refactor (#2495)
* working on masking fix

* refactor and fix multipack seqlens

* pre-commit fix

* adding smoke test

* using existing packed seqlens util

* log warning re: logged losses / gradient scaling per rank
2025-04-07 14:47:57 -04:00
..
2025-03-31 17:15:23 -04:00
2025-04-07 10:49:15 -04:00
2025-04-07 10:49:15 -04:00
2025-04-07 14:47:57 -04:00