Wing Lian caf5cb63ea add e2e smoke test for using activation/gradient checkpointing with offload (#2565) ...

* add e2e smoke test for using activation/gradient checkpointing with offload

* disable duplicate code check for the test

* fix relative import

* seq len too small to test this dataset with packing

* Fix checkpoint ptaching for tests

2025-04-25 21:11:17 -04:00

..

lora_kernels

make sure the all of the model is on the same device, so this test will pass on multigpu (#2524) [skip ci]

2025-04-15 22:15:42 -07:00

__init__.py

attempt to also run e2e tests that needs gpus (#1070)

2024-01-09 21:23:23 -05:00

test_4d_multipack_llama.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00

test_activation_checkpointing.py

add e2e smoke test for using activation/gradient checkpointing with offload (#2565)

2025-04-25 21:11:17 -04:00

test_cli_integrations.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_fa_xentropy.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_falcon_samplepack.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00

test_fused_llama.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00

test_llama_s2_attention.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00

test_lora_llama_multipack.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00

test_mistral_samplepack.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00

test_mixtral_samplepack.py

Sequence parallel training context manager (#2553)

2025-04-25 10:33:54 -04:00

test_model_patches.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00

test_phi_multipack.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00

test_resume.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00

test_sp.py

Sequence parallel training context manager (#2553)

2025-04-25 10:33:54 -04:00

test_unsloth_integration.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_unsloth_qlora.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00