Wing Lian c70dae63cc add chatml

2023-08-07 09:38:04 -04:00

..

monkeypatch

fix flash-attn, xformers, packing, support chatml

2023-08-07 09:38:04 -04:00

prompt_strategies

fix chatml system prompt for openorca, legacy tokenizer opts

2023-08-07 09:38:04 -04:00

utils

fix chatml system prompt for openorca, legacy tokenizer opts

2023-08-07 09:38:04 -04:00

__init__.py

WIP for axolotl trainer

2023-04-14 00:20:05 -04:00

convert.py

Lint convert.py

2023-05-31 02:53:53 +09:00

datasets.py

add position_ids back

2023-08-07 09:38:03 -04:00

logging_config.py

misc fixes

2023-07-17 03:00:27 -04:00

prompt_tokenizers.py

better handling since xgen tokenizer breaks with convert_tokens_to_ids

2023-07-21 09:24:11 -04:00

prompters.py

add chatml

2023-08-07 09:38:04 -04:00