Improve Inference instruction
This commit is contained in:
14
README.md
14
README.md
@@ -317,12 +317,16 @@ accelerate launch scripts/finetune.py configs/your_config.yml
|
||||
|
||||
### Inference
|
||||
|
||||
Add `--inference` flag to train command above
|
||||
Pass the appropriate flag to the train command:
|
||||
|
||||
If you are inferencing a pretrained LORA, pass
|
||||
```bash
|
||||
--lora_model_dir ./completed-model
|
||||
```
|
||||
- Pretrained LORA:
|
||||
```bash
|
||||
--inference --lora_model_dir ./completed-model
|
||||
```
|
||||
- Full weights finetune:
|
||||
```bash
|
||||
--inference --base_model ./completed-model
|
||||
```
|
||||
|
||||
### Merge LORA to base
|
||||
|
||||
|
||||
Reference in New Issue
Block a user