Wing Lian 1210dc8fd5 more tweaks to do pre-training with bettertransformers

2023-06-10 14:23:55 -04:00

..

monkeypatch

add support to extend context with xpos rope

2023-06-10 10:29:46 -04:00

prompt_strategies

fix camel ai, add guanaco/oasst mapping for sharegpt

2023-06-07 09:51:29 -04:00

utils

more tweaks to do pre-training with bettertransformers

2023-06-10 14:23:55 -04:00

__init__.py

WIP for axolotl trainer

2023-04-14 00:20:05 -04:00

convert.py

Lint convert.py

2023-05-31 02:53:53 +09:00

datasets.py

fix packing so that concatenated sequences reset the attention

2023-05-31 11:38:52 -04:00

flash_attn.py

don't worry about dupes

2023-05-31 00:06:47 -04:00

prompt_tokenizers.py

Fix sharegpt prompt

2023-05-31 02:55:21 +09:00

prompters.py

Fix sharegpt prompt

2023-05-31 02:55:21 +09:00