Dan Saunders ae1c7ace63 Sequence parallel training context manager (#2553) ...

* ctx manager for SP

* updates

* update

* further simplifying

* accommodate both training context managers

* simplifying

* simplifying

* nit

* reorg

* tweak codecov yaml

* add gather post hook, simplify, fixes

* pytest

* pytest fix

2025-04-25 10:33:54 -04:00

..

lora_kernels

make sure the all of the model is on the same device, so this test will pass on multigpu (#2524) [skip ci]

2025-04-15 22:15:42 -07:00

__init__.py

attempt to also run e2e tests that needs gpus (#1070)

2024-01-09 21:23:23 -05:00

test_4d_multipack_llama.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00

test_cli_integrations.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_fa_xentropy.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_falcon_samplepack.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00

test_fused_llama.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00

test_llama_s2_attention.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00

test_lora_llama_multipack.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00

test_mistral_samplepack.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00

test_mixtral_samplepack.py

Sequence parallel training context manager (#2553)

2025-04-25 10:33:54 -04:00

test_model_patches.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00

test_phi_multipack.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00

test_resume.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00

test_sp.py

Sequence parallel training context manager (#2553)

2025-04-25 10:33:54 -04:00

test_unsloth_integration.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_unsloth_qlora.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00