Update quickstart config
This commit is contained in:
@@ -33,12 +33,12 @@ pip3 install -e .[int4]
|
|||||||
|
|
||||||
accelerate config
|
accelerate config
|
||||||
|
|
||||||
# finetune
|
# finetune lora
|
||||||
accelerate launch scripts/finetune.py examples/4bit-lora-7b/config.yml
|
accelerate launch scripts/finetune.py examples/lora-openllama-3b/config.yml
|
||||||
|
|
||||||
# inference
|
# inference
|
||||||
accelerate launch scripts/finetune.py examples/4bit-lora-7b/config.yml \
|
accelerate launch scripts/finetune.py examples/lora-openllama-3b/config.yml \
|
||||||
--inference --lora_model_dir="./llama-7b-lora-int4"
|
--inference --lora_model_dir="./lora-out"
|
||||||
```
|
```
|
||||||
|
|
||||||
## Installation
|
## Installation
|
||||||
|
|||||||
Reference in New Issue
Block a user