Wing Lian 87d7825435 Tokenization open assistant (#1) ...

* refactor prompt tokenization to more easily support open assistant

* add open assisstant handling, more logging, black formatting

2023-04-18 01:45:49 -04:00

..

alpaca_json_to_jsonl.py

black formatting

2023-04-14 07:25:52 -04:00

finetune.py

Tokenization open assistant (#1)

2023-04-18 01:45:49 -04:00