Files

Wing Lian 674c57692d more sane defaults for openllama 3b used for quickstarts (#602 )

* more sane defaults for openllama 3b used for quickstarts

* don't use bf16 for quickstart to simplify gpu compatibility

* use the update openlm-research/open_llama_3b_v2 models

2023-09-19 09:15:10 -04:00

config.yml

more sane defaults for openllama 3b used for quickstarts (#602 )

2023-09-19 09:15:10 -04:00

lora.yml

more sane defaults for openllama 3b used for quickstarts (#602 )

2023-09-19 09:15:10 -04:00

qlora.yml

more sane defaults for openllama 3b used for quickstarts (#602 )

2023-09-19 09:15:10 -04:00

README.md

Fix config path after config moved

2023-06-12 17:06:15 +09:00

README.md

openllama-3b

Basic full tune

accelerate launch scripts/finetune.py examples/openllama-3b/config.yml

LoRA

accelerate launch scripts/finetune.py examples/openllama-3b/lora.yml

QLoRA

accelerate launch scripts/finetune.py examples/openllama-3b/qlora.yml