Wing Lian 8d20e0a3d3 initial wip to get sys prompt from dataset

2023-06-25 22:28:07 -04:00

..

fixtures

fix packing so that concatenated sequences reset the attention

2023-05-31 11:38:52 -04:00

test_dict.py

Ignore unsupported-binary-operation

2023-05-31 02:53:53 +09:00

test_packed_dataset.py

don't worry about duplicate code here

2023-05-31 12:05:43 -04:00

test_prompt_tokenizers.py

fix test name

2023-06-15 02:09:33 -04:00

test_prompters.py

initial wip to get sys prompt from dataset

2023-06-25 22:28:07 -04:00

test_tokenizers.py

optionally define whether to use_fast tokenizer

2023-06-25 10:19:49 -04:00

test_validation.py

Additional test case per pr

2023-06-15 10:12:47 -04:00