Files

Wing Lian 9f824ef76a simplify the example configs to be more minimal and less daunting (#2486 ) [skip ci]

* simplify the example configs to be more minimal and less daunting

* drop empty s2_attention from example yamls

2025-04-04 13:47:26 -04:00

config.yml

2025-04-04 13:47:26 -04:00

lora.yml

2025-04-04 13:47:26 -04:00

qlora.yml

2025-04-04 13:47:26 -04:00

README.md

2023-06-12 17:06:15 +09:00

openllama-3b

Basic full tune

accelerate launch scripts/finetune.py examples/openllama-3b/config.yml

LoRA

accelerate launch scripts/finetune.py examples/openllama-3b/lora.yml

QLoRA

accelerate launch scripts/finetune.py examples/openllama-3b/qlora.yml