NanoCode012 19a600a8b8 Feat: Add support for upstream FA2 (#626) ...

* Feat: Add support for upstream FA2

* chore: add is_falcon_derived_model: true to examples

* chore: add config to readme for documentation

* feat: add extra model types

* fix: remove old falcon flash patch

* chore: pin transformers and accelerate

2023-09-26 09:53:28 -04:00

..

cerebras

btlm and falcon monkey patches for flash attn (#566)

2023-09-17 13:49:18 -04:00

code-llama

Fix Codellama examples (#582)

2023-09-15 04:19:13 -04:00

falcon

Feat: Add support for upstream FA2 (#626)

2023-09-26 09:53:28 -04:00

gptj

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

jeopardy-bot

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

llama-2

default model changed

2023-09-24 18:52:53 +02:00

mpt-7b

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

openllama-3b

more sane defaults for openllama 3b used for quickstarts (#602)

2023-09-19 09:15:10 -04:00

phi

make phi training work with Loras (#588)

2023-09-15 20:51:55 -04:00

pythia

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

pythia-12b

pad_to_worst_case_seq_len boolean, for testing memory limits (#498)

2023-08-28 18:47:16 -04:00

redpajama

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

replit-3b

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

xgen-7b

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00