NanoCode012 1115c501b8 Feat: Add Qwen (#894) ...

* Feat: Add Qwen

* feat: add qwen lora example

* feat: update matrix

* fix: add trust_remote_code

* fix: disable gradient checkpointing

* chore: add warning about gradient checkpointing

* fix: config

* fix: turn off sample packing for this example and reduce seq len

* chore: add comment on seq len

2023-11-26 00:05:01 +09:00

..

cerebras

don't compile deepspeed or bitsandbytes from source (#837)

2023-11-08 19:49:55 -05:00

code-llama

don't compile deepspeed or bitsandbytes from source (#837)

2023-11-08 19:49:55 -05:00

falcon

don't compile deepspeed or bitsandbytes from source (#837)

2023-11-08 19:49:55 -05:00

gptj

don't compile deepspeed or bitsandbytes from source (#837)

2023-11-08 19:49:55 -05:00

jeopardy-bot

fix eval_steps to be a sane default (#797)

2023-10-27 22:36:30 -04:00

llama-2

various bugfixes (#856)

2023-11-15 12:23:18 -05:00

mistral

don't compile deepspeed or bitsandbytes from source (#837)

2023-11-08 19:49:55 -05:00

mpt-7b

fix eval_steps to be a sane default (#797)

2023-10-27 22:36:30 -04:00

openllama-3b

don't compile deepspeed or bitsandbytes from source (#837)

2023-11-08 19:49:55 -05:00

phi

Phi update 202311 (#876)

2023-11-17 12:47:17 -05:00

pythia

fix eval_steps to be a sane default (#797)

2023-10-27 22:36:30 -04:00

pythia-12b

simplify by removing duplicate base_model_config (#772)

2023-10-23 01:42:38 -04:00

qwen

Feat: Add Qwen (#894)

2023-11-26 00:05:01 +09:00

redpajama

fix eval_steps to be a sane default (#797)

2023-10-27 22:36:30 -04:00

replit-3b

fix eval_steps to be a sane default (#797)

2023-10-27 22:36:30 -04:00

xgen-7b

don't compile deepspeed or bitsandbytes from source (#837)

2023-11-08 19:49:55 -05:00