Dan Saunders 35fdbce102 Ensure device mesh patching is applied (#2842) ...

* move patches; make patch stronger

* fix broken tests

* guard sequence_parallel_degree comparison against none

---------

Co-authored-by: Wing Lian <wing@axolotl.ai>

2025-06-29 22:16:32 -04:00

..

integrations

KD fix w/ online distillation (#2700) [skip ci]

2025-06-17 12:09:13 -04:00

kernels

add manual seed for flaky test_geglu_backward test (#2763) [skip ci]

2025-06-05 09:23:17 -07:00

multigpu

Accelerate 1.8.1 and BNB 0.46.0 update (#2815)

2025-06-28 15:29:19 -04:00

patched

Ensure device mesh patching is applied (#2842)

2025-06-29 22:16:32 -04:00

solo

bump transformers==4.52.4 (#2800) [skip ci]

2025-06-18 15:46:14 -04:00

__init__.py

missing dunder-init

2023-11-06 18:33:01 -05:00

.gitignore

Support Sample packing for phi arch (#586)

2023-09-15 15:46:54 -04:00

test_deepseekv3.py

Data loader refactor (#2707)

2025-06-10 19:53:07 -04:00

test_dpo.py

Data loader refactor (#2707)

2025-06-10 19:53:07 -04:00

test_embeddings_lr.py

Data loader refactor (#2707)

2025-06-10 19:53:07 -04:00

test_evaluate.py

remove deprecated wandb env var (#2751)

2025-06-03 14:04:15 -07:00

test_falcon.py

Data loader refactor (#2707)

2025-06-10 19:53:07 -04:00

test_gemma2.py

Data loader refactor (#2707)

2025-06-10 19:53:07 -04:00

test_gemma3_text.py

Data loader refactor (#2707)

2025-06-10 19:53:07 -04:00

test_imports.py

Fix: RL base feature parity (#2133)

2025-05-30 11:21:47 +07:00

test_llama_pretrain.py

bump transformers==4.52.4 (#2800) [skip ci]

2025-06-18 15:46:14 -04:00

test_llama_vision.py

Data loader refactor (#2707)

2025-06-10 19:53:07 -04:00

test_llama.py

Data loader refactor (#2707)

2025-06-10 19:53:07 -04:00

test_load_model.py

models.py -> loaders/ module refactor (#2680)

2025-05-23 15:51:11 -04:00

test_lora_llama.py

Data loader refactor (#2707)

2025-06-10 19:53:07 -04:00

test_mamba.py

Data loader refactor (#2707)

2025-06-10 19:53:07 -04:00

test_mistral.py

Data loader refactor (#2707)

2025-06-10 19:53:07 -04:00

test_mixtral.py

Data loader refactor (#2707)

2025-06-10 19:53:07 -04:00

test_optimizers.py

Data loader refactor (#2707)

2025-06-10 19:53:07 -04:00

test_packing_loss.py

bump transformers==4.52.4 (#2800) [skip ci]

2025-06-18 15:46:14 -04:00

test_phi.py

Data loader refactor (#2707)

2025-06-10 19:53:07 -04:00

test_process_reward_model_smollm2.py

Data loader refactor (#2707)

2025-06-10 19:53:07 -04:00

test_qat.py

bump transformers==4.52.4 (#2800) [skip ci]

2025-06-18 15:46:14 -04:00

test_quantization.py

QAT (#2590)

2025-05-28 12:35:47 +01:00

test_qwen.py

remove deprecated wandb env var (#2751)

2025-06-03 14:04:15 -07:00

test_reward_model_smollm2.py

bump transformers==4.52.4 (#2800) [skip ci]

2025-06-18 15:46:14 -04:00

test_schedulers.py

Data loader refactor (#2707)

2025-06-10 19:53:07 -04:00

utils.py

QAT (#2590)

2025-05-28 12:35:47 +01:00