Wing Lian 8cace80175 fix fixture for new tokenizer handling in transformers (#428)

2023-08-17 17:01:52 -04:00

..

alpaca

fix packing so that concatenated sequences reset the attention

2023-05-31 11:38:52 -04:00

conversation.json

add unit test for sharegpt tokenization

2023-05-30 10:28:17 -04:00

conversation.tokenized_llama2chat.json

fix fixture for new tokenizer handling in transformers (#428)

2023-08-17 17:01:52 -04:00

conversation.tokenized.json

Fix pre-commit for rebased files

2023-05-31 03:01:38 +09:00