Dan Saunders 5410195e0b Sequence parallelism quick follow-ups; remove ModelCallback (#2450) ...

* guard return if ring attn alrady registered

* add docs link, bits in multi-gpu docs, remove save model callback (subsumed by HF trainers)

* configurable heads_k_stride from ring-flash-attn hf adapter

2025-03-31 09:13:42 -04:00

..

integrations

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

kernels

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

multigpu

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

patched

Sequence parallelism quick follow-ups; remove ModelCallback (#2450)

2025-03-31 09:13:42 -04:00

solo

bump HF versions except for trl (#2427)

2025-03-20 10:22:05 -04:00

__init__.py

missing dunder-init

2023-11-06 18:33:01 -05:00

.gitignore

Support Sample packing for phi arch (#586)

2023-09-15 15:46:54 -04:00

test_deepseekv3.py

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

test_dpo.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_embeddings_lr.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_falcon.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_gemma2.py

Feat: Add support for gemma3_text and add e2e for gemma2 (#2406)

2025-03-22 20:33:21 -04:00

test_gemma3_text.py

Feat: Rework multimodal support (mllama, llava, pixtral, qwen2, qwen25, gemma3, mistral3) (#2435)

2025-03-23 11:08:51 -04:00

test_imports.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_llama_pretrain.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_llama_vision.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_llama.py

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

test_load_model.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_lora_llama.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_mamba.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_mistral.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_mixtral.py

Optimizer refactor and add Muon support (#2367)

2025-03-06 11:49:19 -05:00

test_optimizers.py

Optimizer refactor and add Muon support (#2367)

2025-03-06 11:49:19 -05:00

test_packing_loss.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_phi.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_process_reward_model_smollm2.py

Misc fixes 20250130 (#2301)

2025-01-31 08:58:04 -05:00

test_qwen.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_reward_model_smollm2.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_schedulers.py

Feat: Add support for gemma3_text and add e2e for gemma2 (#2406)

2025-03-22 20:33:21 -04:00

utils.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00