tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
Files
34af1b465fe090d4c89e7b2b431886384cdfc763
axolotl/scripts/finetune.py
Wing Lian 87d7825435 Tokenization open assistant (#1) 
* refactor prompt tokenization to more easily support open assistant

* add open assisstant handling, more logging, black formatting
2023-04-18 01:45:49 -04:00

21 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink