Files

NanoCode012 a1da39cd48 Feat(wandb): Refactor to be more flexible (#767 )

* Feat: Update to handle wandb env better

* chore: rename wandb_run_id to wandb_name

* feat: add new recommendation and update config

* fix: indent and pop disabled env if project passed

* feat: test env set for wandb and recommendation

* feat: update to use wandb_name and allow id

* chore: add info to readme

2023-12-04 22:17:25 +09:00

config.yml

Feat(wandb): Refactor to be more flexible (#767 )

2023-12-04 22:17:25 +09:00

lora.yml

Feat(wandb): Refactor to be more flexible (#767 )

2023-12-04 22:17:25 +09:00

qlora.yml

Feat(wandb): Refactor to be more flexible (#767 )

2023-12-04 22:17:25 +09:00

README.md

Fix config path after config moved

2023-06-12 17:06:15 +09:00

README.md

openllama-3b

Basic full tune

accelerate launch scripts/finetune.py examples/openllama-3b/config.yml

LoRA

accelerate launch scripts/finetune.py examples/openllama-3b/lora.yml

QLoRA

accelerate launch scripts/finetune.py examples/openllama-3b/qlora.yml