Wing Lian 097d367af6 tweaks to data loading, 8 bit adam, accelerate and deepspeed

2023-04-24 09:41:35 -04:00

..

accelerate

quickstart instructions for starting from runpod (#5)

2023-04-18 19:22:25 -04:00

cerebras_1_3B_alpaca.yml

4bit quantized support (wip)

2023-04-17 11:37:39 -04:00

gpt_neox_20b.yml

WIP large refactor to make finetune script a little more manageable (#3)

2023-04-18 14:01:38 -04:00

llama_7B_4bit.yml

quickstart instructions for starting from runpod (#5)

2023-04-18 19:22:25 -04:00

llama_7B_alpaca.yml

fix lora target module, require explicit flash attention, fix min logging steps, don't use adam8bit for int4, hash prepared datasets, support hf hub datasets

2023-04-17 18:01:12 -04:00

llama_13B_alpaca.yml

tweaks to data loading, 8 bit adam, accelerate and deepspeed

2023-04-24 09:41:35 -04:00

llama_65B_alpaca.yml

fix sharegpt handling from hf, don't worry about loading llama if using earlier transformers release

2023-04-24 09:41:35 -04:00

pythia_1_2B_alpaca.yml

4bit quantized support (wip)

2023-04-17 11:37:39 -04:00

quickstart.yml

quickstart instructions for starting from runpod (#5)

2023-04-18 19:22:25 -04:00

sample.yml

quickstart instructions for starting from runpod (#5)

2023-04-18 19:22:25 -04:00

stability_3b.yml

various bugfixes

2023-04-24 09:41:34 -04:00

vicuna_13B_4bit_reflect.yml

add support for alpaca reflect training (#2)

2023-04-18 08:34:05 -04:00