Wing Lian 674c57692d more sane defaults for openllama 3b used for quickstarts (#602) ...

* more sane defaults for openllama 3b used for quickstarts

* don't use bf16 for quickstart to simplify gpu compatibility

* use the update openlm-research/open_llama_3b_v2 models

2023-09-19 09:15:10 -04:00

..

cerebras

btlm and falcon monkey patches for flash attn (#566)

2023-09-17 13:49:18 -04:00

code-llama

Fix Codellama examples (#582)

2023-09-15 04:19:13 -04:00

falcon

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

gptj

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

jeopardy-bot

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

llama-2

Add training callback to send predictions to WandB table (#521)

2023-09-13 09:51:08 -04:00

mpt-7b

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

openllama-3b

more sane defaults for openllama 3b used for quickstarts (#602)

2023-09-19 09:15:10 -04:00

phi

make phi training work with Loras (#588)

2023-09-15 20:51:55 -04:00

pythia

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

pythia-12b

pad_to_worst_case_seq_len boolean, for testing memory limits (#498)

2023-08-28 18:47:16 -04:00

redpajama

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

replit-3b

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

xgen-7b

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00