Wing Lian 61f44f311e fix packing for tokenizers that don't use a bos_token when the bos token and eos token are both the same

2023-06-13 21:26:13 -04:00

..

fixtures

fix packing so that concatenated sequences reset the attention

2023-05-31 11:38:52 -04:00

test_dict.py

Ignore unsupported-binary-operation

2023-05-31 02:53:53 +09:00

test_packed_dataset.py

fix packing for tokenizers that don't use a bos_token when the bos token and eos token are both the same

2023-06-13 21:26:13 -04:00

test_prompt_tokenizers.py

don't worry about duplicate code here

2023-05-31 12:05:43 -04:00

test_prompters.py

Lint test_prompters

2023-05-31 02:53:53 +09:00

test_validation.py

new validation for mpt w grad checkpoints

2023-06-11 09:26:10 -04:00