Improve Inference instruction

This commit is contained in:
NanoCode012
2023-05-25 17:04:44 +09:00
parent de2a7335e6
commit 8552218491

View File

@@ -317,12 +317,16 @@ accelerate launch scripts/finetune.py configs/your_config.yml
### Inference
Add `--inference` flag to train command above
Pass the appropriate flag to the train command:
If you are inferencing a pretrained LORA, pass
```bash
--lora_model_dir ./completed-model
```
- Pretrained LORA:
```bash
--inference --lora_model_dir ./completed-model
```
- Full weights finetune:
```bash
--inference --base_model ./completed-model
```
### Merge LORA to base