NanoCode012 eb41f76f92 Feat: Add example for Mistral (#644) ...

* Feat: Add example for Mistral

* chore: turn off flash

* chore: add is_mistral_derived_model

* chore: update following PR

2023-09-28 20:15:00 +09:00

..

cerebras

btlm and falcon monkey patches for flash attn (#566)

2023-09-17 13:49:18 -04:00

code-llama

Fix Codellama examples (#582)

2023-09-15 04:19:13 -04:00

falcon

Feat: Add support for upstream FA2 (#626)

2023-09-26 09:53:28 -04:00

gptj

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

jeopardy-bot

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

llama-2

eval_table isn't quite stable enough to be in default llama configs (#637)

2023-09-26 10:13:20 -04:00

mistral

Feat: Add example for Mistral (#644)

2023-09-28 20:15:00 +09:00

mpt-7b

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

openllama-3b

more sane defaults for openllama 3b used for quickstarts (#602)

2023-09-19 09:15:10 -04:00

phi

make phi training work with Loras (#588)

2023-09-15 20:51:55 -04:00

pythia

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

pythia-12b

pad_to_worst_case_seq_len boolean, for testing memory limits (#498)

2023-08-28 18:47:16 -04:00

redpajama

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

replit-3b

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

xgen-7b

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00