Dan Saunders b8c633aa97 batch api HF adapter for ring-flash-attn; cleanup and improvements (#2520) ...

* batch api HF adapter for ring-flash-attn; cleanup and improvements

* update

* adding all batch ring-flash-attn methods via single adapter

* removing pad_to_sequence_len=False for now

* fix

* updating docs to include batch SP

* review comments

* fixes for batch API funcs, simplify

* fixes

* fix

* updates

* add batch_zigzag smoke test

2025-04-16 13:50:48 -04:00

..

integrations

make e2e tests a bit faster by reducing test split size (#2522) [skip ci]

2025-04-12 07:24:43 -07:00

kernels

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

multigpu

batch api HF adapter for ring-flash-attn; cleanup and improvements (#2520)

2025-04-16 13:50:48 -04:00

patched

batch api HF adapter for ring-flash-attn; cleanup and improvements (#2520)

2025-04-16 13:50:48 -04:00

solo

make e2e tests a bit faster by reducing test split size (#2522) [skip ci]

2025-04-12 07:24:43 -07:00

__init__.py

missing dunder-init

2023-11-06 18:33:01 -05:00

.gitignore

Support Sample packing for phi arch (#586)

2023-09-15 15:46:54 -04:00

test_deepseekv3.py

make e2e tests a bit faster by reducing test split size (#2522) [skip ci]

2025-04-12 07:24:43 -07:00

test_dpo.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_embeddings_lr.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_falcon.py

make e2e tests a bit faster by reducing test split size (#2522) [skip ci]

2025-04-12 07:24:43 -07:00

test_gemma2.py

make e2e tests a bit faster by reducing test split size (#2522) [skip ci]

2025-04-12 07:24:43 -07:00

test_gemma3_text.py

make e2e tests a bit faster by reducing test split size (#2522) [skip ci]

2025-04-12 07:24:43 -07:00

test_imports.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_llama_pretrain.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_llama_vision.py

make e2e tests a bit faster by reducing test split size (#2522) [skip ci]

2025-04-12 07:24:43 -07:00

test_llama.py

make e2e tests a bit faster by reducing test split size (#2522) [skip ci]

2025-04-12 07:24:43 -07:00

test_load_model.py

make e2e tests a bit faster by reducing test split size (#2522) [skip ci]

2025-04-12 07:24:43 -07:00

test_lora_llama.py

make e2e tests a bit faster by reducing test split size (#2522) [skip ci]

2025-04-12 07:24:43 -07:00

test_mamba.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_mistral.py

make e2e tests a bit faster by reducing test split size (#2522) [skip ci]

2025-04-12 07:24:43 -07:00

test_mixtral.py

make e2e tests a bit faster by reducing test split size (#2522) [skip ci]

2025-04-12 07:24:43 -07:00

test_optimizers.py

make e2e tests a bit faster by reducing test split size (#2522) [skip ci]

2025-04-12 07:24:43 -07:00

test_packing_loss.py

make e2e tests a bit faster by reducing test split size (#2522) [skip ci]

2025-04-12 07:24:43 -07:00

test_phi.py

make e2e tests a bit faster by reducing test split size (#2522) [skip ci]

2025-04-12 07:24:43 -07:00

test_process_reward_model_smollm2.py

Misc fixes 20250130 (#2301)

2025-01-31 08:58:04 -05:00

test_qwen.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_reward_model_smollm2.py

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

test_schedulers.py

make e2e tests a bit faster by reducing test split size (#2522) [skip ci]

2025-04-12 07:24:43 -07:00

utils.py

Flex Attention + Packing with BlockMask support (#2363)

2025-04-05 18:02:57 -04:00