Improve Inference instruction
This commit is contained in:
14
README.md
14
README.md
@@ -317,12 +317,16 @@ accelerate launch scripts/finetune.py configs/your_config.yml
|
|||||||
|
|
||||||
### Inference
|
### Inference
|
||||||
|
|
||||||
Add `--inference` flag to train command above
|
Pass the appropriate flag to the train command:
|
||||||
|
|
||||||
If you are inferencing a pretrained LORA, pass
|
- Pretrained LORA:
|
||||||
```bash
|
```bash
|
||||||
--lora_model_dir ./completed-model
|
--inference --lora_model_dir ./completed-model
|
||||||
```
|
```
|
||||||
|
- Full weights finetune:
|
||||||
|
```bash
|
||||||
|
--inference --base_model ./completed-model
|
||||||
|
```
|
||||||
|
|
||||||
### Merge LORA to base
|
### Merge LORA to base
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user