Dan Saunders 80304c26a7 SP GRPO support + batch SP fixes (#2643) ...

* ctx manager for SP

* updates

* update

* further simplifying

* simplifying

* simplifying

* reorg

* batch api HF adapter for ring-flash-attn; cleanup and improvements

* update

* adding all batch ring-flash-attn methods via single adapter

* fix

* fixes for batch API funcs, simplify

* fix

* grpo sp support

* progress

* stronger subclassing of TRL GRPO trainer; custom distributed sampler

* subclassing constructor

* progress

* finalizing SP + GRPO trainer

* minimize diffs to GRPO trainer

* remove (most of) the custom GRPO trainer logic

* debug

* debug

* update

* update

* update

* progress

* cleanup

* cleanup

* minor changes

* update

* update

* update

* small changes

* updates

* cleanup; torch.compile ring_flash_attn functions to prevent numerical instability; lint

* spacing

* cleanup; log in pydantic model config only on main process

* remove comment

* fix sp sampler, update to latest upstream code, doc

* add docs

* update quartodoc autodoc contents

* fix, simplifications

* fixes + simplifications

* review comments

* lint

* removing main process only logs in favor of #2608

* fixes, additional smoke test

* updatse

* more tests

* update

* fix grad accum bug (sort of)

* lint, tests

* todo

2025-05-12 17:52:40 -04:00

..

cli

add mocks for loading datasets in cli train tests (#2497) [skip ci]

2025-04-11 09:51:59 -04:00

core

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

e2e

SP GRPO support + batch SP fixes (#2643)

2025-05-12 17:52:40 -04:00

fixtures

Respect sequence_len in config for type: llama2_chat (#926)

2023-12-12 09:39:22 -08:00

integrations

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

monkeypatch

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

patched

automatically set pad_to_sequence_len when use packing (#2607)

2025-05-01 13:24:38 -04:00

prompt_strategies

Handle other reasoning trace dataset formats (#2591)

2025-04-30 03:32:55 -04:00

utils

replace references to random 68m model w 135m smollm2 (#2570) [skip ci]

2025-04-28 10:08:07 -04:00

__init__.py

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

conftest.py

repop cache (#2639)

2025-05-06 11:09:07 -04:00

constants.py

Add Exact Deduplication Feature to Preprocessing Pipeline (#2072)

2024-12-02 08:47:10 -05:00

hf_offline_utils.py

fix tokenizer overrides w gemma3 (#2488)

2025-04-05 01:25:44 -04:00

test_data.py

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

test_datasets.py

swap tinymodels that have safetensors for some ci tests (#2641)

2025-05-07 15:06:07 -04:00

test_dict.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_exact_deduplication.py

make sure to validate the config before normalizing so defaults get set (#2554)

2025-04-24 13:01:43 -04:00

test_expand_mask.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_freeze.py

Train parameters exclusively in specific ranges (#1390)

2024-03-14 11:05:42 -04:00

test_lora.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_normalize_config.py

replace references to random 68m model w 135m smollm2 (#2570) [skip ci]

2025-04-28 10:08:07 -04:00

test_packed_batch_sampler.py

don't sort multipack sampler (#2657)

2025-05-09 20:28:58 -04:00

test_packed_dataset.py

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

test_packed_pretraining.py

fix streaming packing test (#2454)

2025-03-29 08:30:06 -04:00

test_perplexity.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_prompt_tokenizers.py

Release update 20250331 (#2460) [skip ci]

2025-04-01 08:47:50 -04:00

test_prompters.py

fix: prompt phi (#1845) [skip ci]

2024-08-22 11:46:57 -04:00

test_schedulers.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_tokenizers.py

fix tokenizer overrides w gemma3 (#2488)

2025-04-05 01:25:44 -04:00

test_validation_dataset.py

Validation for Muon optimizer with DS/FSDP (#2464)

2025-04-01 09:39:12 -04:00