NanoCode012 697c50d408 Feat: Allow usage of native Mistral FA when no sample_packing (#669) ...

* Allow usage of native Mistral FA when no sample_packing

* fix: do not apply custom patch when sample_pack off

* chore: lint

* chore: pin transformer to v4.35.0.dev0

* fix: split sample_packing to separate test

2023-10-04 20:40:47 +09:00

..

e2e

Feat: Allow usage of native Mistral FA when no sample_packing (#669)

2023-10-04 20:40:47 +09:00

fixtures

use fastchat conversations template (#578)

2023-09-27 12:10:45 -04:00

monkeypatch

Attention mask and position id fixes for packing (#285)

2023-08-12 15:14:56 -04:00

test_data.py

Fix pretraining with iterable/streaming Dataset (#556)

2023-09-13 00:16:40 -04:00

test_dict.py

fix DefaultDict.__or__

2023-08-13 01:15:50 +00:00

test_expand_mask.py

Attention mask and position id fixes for packing (#285)

2023-08-12 15:14:56 -04:00

test_packed_dataset.py

Attention mask and position id fixes for packing (#285)

2023-08-12 15:14:56 -04:00

test_prompt_tokenizers.py

use fastchat conversations template (#578)

2023-09-27 12:10:45 -04:00

test_prompters.py

Attention mask and position id fixes for packing (#285)

2023-08-12 15:14:56 -04:00

test_tokenizers.py

simplify load_tokenizer

2023-08-12 18:55:06 -07:00

test_validation.py

Fix(cfg): Add validation for save_strategy and eval_strategy (#633)

2023-09-28 10:14:41 +09:00