Wing Lian e74eab6e73 add a test for the mask expansion for sequence packing

2023-08-07 09:38:04 -04:00

..

fixtures

experimental llama 2 chat support (#296)

2023-08-06 17:40:52 -04:00

test_dict.py

Ignore unsupported-binary-operation

2023-05-31 02:53:53 +09:00

test_expand_mask.py

add a test for the mask expansion for sequence packing

2023-08-07 09:38:04 -04:00

test_packed_dataset.py

set position ids and use block diagonal attn mask

2023-08-07 09:38:03 -04:00

test_prompt_tokenizers.py

experimental llama 2 chat support (#296)

2023-08-06 17:40:52 -04:00

test_prompters.py

update prompts for open orca to match the paper (#317)

2023-07-22 13:49:11 -04:00

test_tokenizers.py

optionally define whether to use_fast tokenizer

2023-06-25 10:19:49 -04:00

test_validation.py

validation for sample packing and doc

2023-08-07 09:38:03 -04:00