Files

Wing Lian 5f79b8242f new evals_per_epoch and saves_per_epoch to make things cleaner (#944 )

* new evals_per_epoch and saves_per_epoch to make things cleaner

* update per PR feedback

2023-12-12 15:35:23 -05:00

config.yml

2023-12-12 15:35:23 -05:00

lora.yml

2023-12-12 15:35:23 -05:00

qlora.yml

2023-12-12 15:35:23 -05:00

README.md

2023-06-12 17:06:15 +09:00

openllama-3b

Basic full tune

accelerate launch scripts/finetune.py examples/openllama-3b/config.yml

LoRA

accelerate launch scripts/finetune.py examples/openllama-3b/lora.yml

QLoRA

accelerate launch scripts/finetune.py examples/openllama-3b/qlora.yml