* Update wandb_entity and add wandb descriptions * add wandb to config section * remove trailing whitespace for pre-commit hook * remove trailing whitespace for pre-commit hook --------- Co-authored-by: Morgan McGuire <morganmcguire@Morgans-MacBook-Pro.local> Co-authored-by: Wing Lian <wing.lian@gmail.com>
openllama-3b
Basic full tune
accelerate launch scripts/finetune.py examples/openllama-3b/config.yml
LoRA
accelerate launch scripts/finetune.py examples/openllama-3b/lora.yml
QLoRA
accelerate launch scripts/finetune.py examples/openllama-3b/qlora.yml