Wing Lian 12a2dbbc2c Support Sample packing for phi arch (#586) ...

* phi sequence packing

* sample packing fixes

* fix linting

* fix inference and phi e2e tests

* update phi example now that sample packing works

* wandb import keeps getting moved around

2023-09-15 15:46:54 -04:00

..

cerebras

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

code-llama

Fix Codellama examples (#582)

2023-09-15 04:19:13 -04:00

falcon

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

gptj

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

jeopardy-bot

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

llama-2

Add training callback to send predictions to WandB table (#521)

2023-09-13 09:51:08 -04:00

mpt-7b

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

openllama-3b

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

phi

Support Sample packing for phi arch (#586)

2023-09-15 15:46:54 -04:00

pythia

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

pythia-12b

pad_to_worst_case_seq_len boolean, for testing memory limits (#498)

2023-08-28 18:47:16 -04:00

redpajama

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

replit-3b

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00

xgen-7b

Add wandb_entity to wandb options, update example configs, update README (#361)

2023-08-12 12:17:11 -04:00