Dan Saunders 5410195e0b Sequence parallelism quick follow-ups; remove ModelCallback (#2450) ...

* guard return if ring attn alrady registered

* add docs link, bits in multi-gpu docs, remove save model callback (subsumed by HF trainers)

* configurable heads_k_stride from ring-flash-attn hf adapter

2025-03-31 09:13:42 -04:00

..

lora_kernels

feat: add CCE for gemma3, cohere, and cohere2 (#2443)

2025-03-26 18:13:51 -04:00

__init__.py

attempt to also run e2e tests that needs gpus (#1070)

2024-01-09 21:23:23 -05:00

test_4d_multipack_llama.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_cli_integrations.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_fa_xentropy.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_falcon_samplepack.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_fused_llama.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_llama_s2_attention.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_lora_llama_multipack.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_mistral_samplepack.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_mixtral_samplepack.py

support for latest transformers release 4.48.1 (#2256)

2025-01-23 21:17:57 -05:00

test_model_patches.py

support for latest transformers release 4.48.1 (#2256)

2025-01-23 21:17:57 -05:00

test_phi_multipack.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_resume.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_sp.py

Sequence parallelism quick follow-ups; remove ModelCallback (#2450)

2025-03-31 09:13:42 -04:00

test_unsloth_integration.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_unsloth_qlora.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00