2 Commits

Author	SHA1	Message	Date
Wing Lian	de8a625dd7	make e2e tests a bit faster by reducing test split size (#2522) [skip ci] ... * [ci] make e2e tests a bit faster by reducing test split size * use 10% split of alpaca dataset to speed up dataset loading/tokenization * reduce gas 4->2 for most e2e tests * increase val set size for packing	2025-04-12 07:24:43 -07:00
Dan Saunders	59cd472504	SP cu_seqlens fix, refactor (#2495) ... * working on masking fix * refactor and fix multipack seqlens * pre-commit fix * adding smoke test * using existing packed seqlens util * log warning re: logged losses / gradient scaling per rank	2025-04-07 14:47:57 -04:00