Wing Lian a363604dcf better handling and logging of empty sharegpt turns (#603)

2023-09-22 16:13:42 -04:00

..

alpaca

fix packing so that concatenated sequences reset the attention

2023-05-31 11:38:52 -04:00

conversation.json

add unit test for sharegpt tokenization

2023-05-30 10:28:17 -04:00

conversation.missingturns.json

better handling and logging of empty sharegpt turns (#603)

2023-09-22 16:13:42 -04:00

conversation.tokenized_llama2chat.json

fix test fixture b/c hf trainer tokenization changed (#464)

2023-08-23 04:04:49 -04:00

conversation.tokenized.json

Fix pre-commit for rebased files

2023-05-31 03:01:38 +09:00