experimental llama 2 chat support (#296)

Browse Source

* experimental llama 2 chat support

* few small fixes

* llama2_chat

* small fix to follow original implementation

* small fixes and added fixtures/tests

* fix -mixed up inference and finetuning conversations

* args - small fix

* small fix

* small adjustment and warning

* fix with pre-commit

---------

Co-authored-by: Jan Philipp Harries <jpdus@users.noreply.github.com>

...

This commit is contained in:

Jan Philipp Harries

2023-08-06 23:40:52 +02:00

committed by GitHub

parent bb53a165f5

commit 3392270544

4 changed files with 292 additions and 2 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

1

tests/fixtures/conversation.tokenized_llama2chat.json vendored Normal file

File diff suppressed because one or more lines are too long