Wing Lian 8cace80175 fix fixture for new tokenizer handling in transformers (#428)

2023-08-17 17:01:52 -04:00

..

fixtures

fix fixture for new tokenizer handling in transformers (#428)

2023-08-17 17:01:52 -04:00

monkeypatch

Attention mask and position id fixes for packing (#285)

2023-08-12 15:14:56 -04:00

test_dict.py

fix DefaultDict.__or__

2023-08-13 01:15:50 +00:00

test_expand_mask.py

Attention mask and position id fixes for packing (#285)

2023-08-12 15:14:56 -04:00

test_packed_dataset.py

Attention mask and position id fixes for packing (#285)

2023-08-12 15:14:56 -04:00

test_prompt_tokenizers.py

Attention mask and position id fixes for packing (#285)

2023-08-12 15:14:56 -04:00

test_prompters.py

Attention mask and position id fixes for packing (#285)

2023-08-12 15:14:56 -04:00

test_tokenizers.py

simplify load_tokenizer

2023-08-12 18:55:06 -07:00

test_validation.py

extract module for working with cfg

2023-08-12 18:25:27 -07:00