Dan Saunders 59cd472504 SP cu_seqlens fix, refactor (#2495) ...

* working on masking fix

* refactor and fix multipack seqlens

* pre-commit fix

* adding smoke test

* using existing packed seqlens util

* log warning re: logged losses / gradient scaling per rank

2025-04-07 14:47:57 -04:00

..

lora_kernels

feat: add CCE for gemma3, cohere, and cohere2 (#2443)

2025-03-26 18:13:51 -04:00

__init__.py

attempt to also run e2e tests that needs gpus (#1070)

2024-01-09 21:23:23 -05:00

test_4d_multipack_llama.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_cli_integrations.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_fa_xentropy.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_falcon_samplepack.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_fused_llama.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_llama_s2_attention.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_lora_llama_multipack.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_mistral_samplepack.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_mixtral_samplepack.py

support for latest transformers release 4.48.1 (#2256)

2025-01-23 21:17:57 -05:00

test_model_patches.py

support for latest transformers release 4.48.1 (#2256)

2025-01-23 21:17:57 -05:00

test_phi_multipack.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_resume.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_sp.py

SP cu_seqlens fix, refactor (#2495)

2025-04-07 14:47:57 -04:00

test_unsloth_integration.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_unsloth_qlora.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00