Update quickstart. Add common error and contribution section.
This commit is contained in:
29
README.md
29
README.md
@@ -22,7 +22,7 @@
|
|||||||
| mpt | ✅ | ❌ | ❌ | ❌ | ❌ | ❓ |
|
| mpt | ✅ | ❌ | ❌ | ❌ | ❌ | ❓ |
|
||||||
|
|
||||||
|
|
||||||
## Quick start
|
## Quickstart ⚡
|
||||||
|
|
||||||
**Requirements**: Python 3.9.
|
**Requirements**: Python 3.9.
|
||||||
|
|
||||||
@@ -32,12 +32,15 @@ git clone https://github.com/OpenAccess-AI-Collective/axolotl
|
|||||||
pip3 install -e .[int4]
|
pip3 install -e .[int4]
|
||||||
|
|
||||||
accelerate config
|
accelerate config
|
||||||
|
|
||||||
|
# finetune
|
||||||
accelerate launch scripts/finetune.py examples/4bit-lora-7b/config.yml
|
accelerate launch scripts/finetune.py examples/4bit-lora-7b/config.yml
|
||||||
|
|
||||||
|
# inference
|
||||||
|
accelerate launch scripts/finetune.py examples/4bit-lora-7b/config.yml --inference
|
||||||
```
|
```
|
||||||
|
|
||||||
|
## Installation
|
||||||
|
|
||||||
## Requirements and Installation
|
|
||||||
|
|
||||||
### Environment
|
### Environment
|
||||||
|
|
||||||
@@ -108,6 +111,8 @@ Have dataset(s) in one of the following format (JSONL recommended):
|
|||||||
{"text": "..."}
|
{"text": "..."}
|
||||||
```
|
```
|
||||||
|
|
||||||
|
> Have some new format to propose? Check if it's already defined in [data.py](src/axolotl/utils/data.py) in `dev` branch!
|
||||||
|
|
||||||
</details>
|
</details>
|
||||||
|
|
||||||
Optionally, download some datasets, see [data/README.md](data/README.md)
|
Optionally, download some datasets, see [data/README.md](data/README.md)
|
||||||
@@ -309,6 +314,7 @@ Configure accelerate
|
|||||||
```bash
|
```bash
|
||||||
accelerate config
|
accelerate config
|
||||||
|
|
||||||
|
# Edit manually
|
||||||
# nano ~/.cache/huggingface/accelerate/default_config.yaml
|
# nano ~/.cache/huggingface/accelerate/default_config.yaml
|
||||||
```
|
```
|
||||||
|
|
||||||
@@ -330,5 +336,18 @@ If you are inferencing a pretrained LORA, pass
|
|||||||
|
|
||||||
### Merge LORA to base (Dev branch 🔧 )
|
### Merge LORA to base (Dev branch 🔧 )
|
||||||
|
|
||||||
Add `--merge_lora --lora_model_dir="path/to/lora"` flag to train command above
|
Add below flag to train command above
|
||||||
|
|
||||||
|
```bash
|
||||||
|
--merge_lora --lora_model_dir="./completed-model"
|
||||||
|
```
|
||||||
|
|
||||||
|
## Common Errors 🧰
|
||||||
|
|
||||||
|
- Cuda out of memory: Please reduce `micro_batch_size` and/or `eval_batch_size`
|
||||||
|
|
||||||
|
## Contributing 🤝
|
||||||
|
|
||||||
|
Bugs? Please check for open issue else create a new [Issue](https://github.com/OpenAccess-AI-Collective/axolotl/issues/new).
|
||||||
|
|
||||||
|
PRs are **greatly welcome**!
|
||||||
Reference in New Issue
Block a user