Files

Wing Lian 94f310c7a6 Merge pull request #193 from OpenAccess-AI-Collective/config-fixes-20230612

config fixes

2023-06-12 08:24:52 -04:00

config.yml

config fixes

2023-06-12 01:52:58 -04:00

lora.yml

config fixes

2023-06-12 01:52:58 -04:00

qlora.yml

2023-06-11 11:03:31 -04:00

README.md

2023-06-12 17:06:15 +09:00

openllama-3b

Basic full tune

accelerate launch scripts/finetune.py examples/openllama-3b/config.yml

LoRA

accelerate launch scripts/finetune.py examples/openllama-3b/lora.yml

QLoRA

accelerate launch scripts/finetune.py examples/openllama-3b/qlora.yml