Wing Lian 328d598114 gemma3 packing fixes (#2449) ...

* make gemma3 work with packing

* multi-gpu e2e for ci

* update gemma3 model namespace to use mirror

* add gradient checkpointing to multigpu e2e ci

* update gemma3 examples for use_reentrant and fix ddp find unused params

* fix tests for gemma3

* fix import for test utils

* set correct train loss for gemma3 e2e

2025-03-31 17:15:23 -04:00

..

cli

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

core

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

e2e

gemma3 packing fixes (#2449)

2025-03-31 17:15:23 -04:00

fixtures

Respect sequence_len in config for type: llama2_chat (#926)

2023-12-12 09:39:22 -08:00

integrations

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

monkeypatch

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

patched

Autodoc generation with quartodoc (#2419)

2025-03-21 12:26:47 -04:00

prompt_strategies

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

utils

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

__init__.py

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

conftest.py

Updates for trl 0.16.0 - mostly for GRPO (#2437) [skip ci]

2025-03-31 15:47:11 -04:00

constants.py

Add Exact Deduplication Feature to Preprocessing Pipeline (#2072)

2024-12-02 08:47:10 -05:00

hf_offline_utils.py

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

test_data.py

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

test_datasets.py

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

test_dict.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_exact_deduplication.py

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

test_expand_mask.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_freeze.py

Train parameters exclusively in specific ranges (#1390)

2024-03-14 11:05:42 -04:00

test_lora.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_normalize_config.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_packed_batch_sampler.py

Sequential sample packing (#2404) [skip ci]

2025-03-31 15:48:20 -04:00

test_packed_dataset.py

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

test_packed_pretraining.py

fix streaming packing test (#2454)

2025-03-29 08:30:06 -04:00

test_perplexity.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_prompt_tokenizers.py

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

test_prompters.py

fix: prompt phi (#1845) [skip ci]

2024-08-22 11:46:57 -04:00

test_schedulers.py

adding pre-commit auto-update GH action and bumping plugin versions (#2428)

2025-03-21 11:02:43 -04:00

test_tokenizers.py

fix: minor patches for multimodal (#2441)

2025-03-31 13:40:12 +07:00

test_validation_dataset.py

Autodoc generation with quartodoc (#2419)

2025-03-21 12:26:47 -04:00