Files

Wing Lian 22810c97b7 use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

* use warmup_ratio as a better default than warmup steps since it's data dependent

* replace remainder of warmup_steps

2025-07-30 06:44:06 -04:00

config.yml

2025-07-30 06:44:06 -04:00

lora.yml

2025-07-30 06:44:06 -04:00

qlora.yml

2025-07-30 06:44:06 -04:00

README.md

2025-07-12 11:39:51 -04:00

openllama-3b

Basic full tune

accelerate launch scripts/finetune.py examples/openllama-3b/config.yml

LoRA

accelerate launch scripts/finetune.py examples/openllama-3b/lora.yml

QLoRA

accelerate launch scripts/finetune.py examples/openllama-3b/qlora.yml