Wing Lian 228420972e Phi examples (#569) ...

* add phi full ft example

* Add readme to point out that deepspeed should be used

* zero1 is better than zero2 for phi

2023-09-14 11:17:47 -04:00

..

cerebras

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

code-llama

recommend padding when using sample packing (#531)

2023-09-06 17:00:21 -04:00

falcon

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

gptj

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

jeopardy-bot

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

llama-2

Add training callback to send predictions to WandB table (#521)

2023-09-13 09:51:08 -04:00

mpt-7b

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

openllama-3b

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

phi

Phi examples (#569)

2023-09-14 11:17:47 -04:00

pythia

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

pythia-12b

pad_to_worst_case_seq_len boolean, for testing memory limits (#498)

2023-08-28 18:47:16 -04:00

redpajama

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

replit-3b

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

xgen-7b

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00