NanoCode012 043c3860cd fix: train_on_inputs: true ignored for sharegpt (#1045) [skip ci] ...

* fix: `train_on_inputs: true` ignored for sharegpt

* enable unit test for train_on_inputs for sharegpt

---------

Co-authored-by: Wing Lian <wing.lian@gmail.com>

2024-01-09 23:00:09 -05:00

..

core

RL/DPO (#935)

2024-01-04 18:22:55 -05:00

e2e

attempt to also run e2e tests that needs gpus (#1070)

2024-01-09 21:23:23 -05:00

fixtures

Respect sequence_len in config for type: llama2_chat (#926)

2023-12-12 09:39:22 -08:00

monkeypatch

Attention mask and position id fixes for packing (#285)

2023-08-12 15:14:56 -04:00

prompt_strategies

fix: train_on_inputs: true ignored for sharegpt (#1045) [skip ci]

2024-01-09 23:00:09 -05:00

test_data.py

Fix pretraining with iterable/streaming Dataset (#556)

2023-09-13 00:16:40 -04:00

test_dict.py

fix DefaultDict.__or__

2023-08-13 01:15:50 +00:00

test_expand_mask.py

Attention mask and position id fixes for packing (#285)

2023-08-12 15:14:56 -04:00

test_normalize_config.py

simplify by removing duplicate base_model_config (#772)

2023-10-23 01:42:38 -04:00

test_packed_dataset.py

Attention mask and position id fixes for packing (#285)

2023-08-12 15:14:56 -04:00

test_packed_pretraining.py

streaming multipack for pretraining dataset (#959)

2024-01-05 22:13:21 -05:00

test_prompt_tokenizers.py

fix mistral prompt assembly (#982)

2023-12-21 08:00:55 -08:00

test_prompters.py

Attention mask and position id fixes for packing (#285)

2023-08-12 15:14:56 -04:00

test_tokenizers.py

Feat: Warns to add to modules_to_save when adding tokens or switching special_tokens (#787)

2023-12-22 21:49:07 +09:00

test_validation.py

be more robust about checking embedding modules for lora finetunes (#1074) [skip ci]

2024-01-09 22:58:54 -05:00