Improve Inference instruction

This commit is contained in:
NanoCode012
2023-05-25 17:04:44 +09:00
parent de2a7335e6
commit 8552218491

View File

@@ -317,12 +317,16 @@ accelerate launch scripts/finetune.py configs/your_config.yml
### Inference ### Inference
Add `--inference` flag to train command above Pass the appropriate flag to the train command:
If you are inferencing a pretrained LORA, pass - Pretrained LORA:
```bash ```bash
--lora_model_dir ./completed-model --inference --lora_model_dir ./completed-model
``` ```
- Full weights finetune:
```bash
--inference --base_model ./completed-model
```
### Merge LORA to base ### Merge LORA to base