Hamel Husain 5ada140ff0 Fix prompt assembly for llama (#952) ...

* start at index 0

* add test to check for missing turns

* apply black

* Update test_prompt_tokenizers.py

* Update src/axolotl/monkeypatch/fastchat_conversation_turns.py

Co-authored-by: Motoki Wu <tokestermw@gmail.com>

* fix linting

* apply black

* add more tests for llama/sharegpt

* make logic clearer

---------

Co-authored-by: Motoki Wu <tokestermw@gmail.com>

2023-12-14 10:03:59 -08:00

14 KiB

Raw Blame History

View Raw