Files

Wing Lian e50a64e85e prepared dataset caching, other misc fixes (#665 )

* prepared dataset caching, other misc fixes

* also don't load from disk cache unless explicit

2023-10-02 21:07:24 -04:00

config.yml

2023-10-02 21:07:24 -04:00

lora.yml

2023-10-02 21:07:24 -04:00

qlora.yml

2023-10-02 21:07:24 -04:00

README.md

2023-06-12 17:06:15 +09:00

openllama-3b

Basic full tune

accelerate launch scripts/finetune.py examples/openllama-3b/config.yml

LoRA

accelerate launch scripts/finetune.py examples/openllama-3b/lora.yml

QLoRA

accelerate launch scripts/finetune.py examples/openllama-3b/qlora.yml