Dan Saunders 5f8f817200 SP context manager update (#2699) ...

* utilize accelerate prepare_data_loader with patching

* lint

* cleanup, fix

* update to support DPO quirk

* coderabbit commits, cleanup, remove dead code

* fix

* move ring attn patching to sp ctx manager

* lint

* lint

* test fix

* test fix

2025-05-22 11:18:32 -04:00

..

lora_kernels

swap tinymodels that have safetensors for some ci tests (#2641)

2025-05-07 15:06:07 -04:00

__init__.py

attempt to also run e2e tests that needs gpus (#1070)

2024-01-09 21:23:23 -05:00

test_4d_multipack_llama.py

Various fixes for CI, save_only_model for RL, prevent packing multiprocessing deadlocks (#2661)

2025-05-12 10:51:18 -04:00

test_activation_checkpointing.py

Activation checkpointing with offloading to disk with prefetch (#2663)

2025-05-13 16:39:39 -04:00

test_cli_integrations.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_fa_xentropy.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_falcon_samplepack.py

swap tinymodels that have safetensors for some ci tests (#2641)

2025-05-07 15:06:07 -04:00

test_fused_llama.py

replace references to random 68m model w 135m smollm2 (#2570) [skip ci]

2025-04-28 10:08:07 -04:00

test_llama_s2_attention.py

replace references to random 68m model w 135m smollm2 (#2570) [skip ci]

2025-04-28 10:08:07 -04:00

test_lora_llama_multipack.py

replace references to random 68m model w 135m smollm2 (#2570) [skip ci]

2025-04-28 10:08:07 -04:00

test_mistral_samplepack.py

Various fixes for CI, save_only_model for RL, prevent packing multiprocessing deadlocks (#2661)

2025-05-12 10:51:18 -04:00

test_mixtral_samplepack.py

Various fixes for CI, save_only_model for RL, prevent packing multiprocessing deadlocks (#2661)

2025-05-12 10:51:18 -04:00

test_model_patches.py

swap tinymodels that have safetensors for some ci tests (#2641)

2025-05-07 15:06:07 -04:00

test_peft_embeddings.py

Configurable embeddings upcast (#2621)

2025-05-06 23:40:44 -04:00

test_phi_multipack.py

Various fixes for CI, save_only_model for RL, prevent packing multiprocessing deadlocks (#2661)

2025-05-12 10:51:18 -04:00

test_resume.py

swap tinymodels that have safetensors for some ci tests (#2641)

2025-05-07 15:06:07 -04:00

test_sp.py

SP context manager update (#2699)

2025-05-22 11:18:32 -04:00

test_unsloth_integration.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_unsloth_qlora.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00