tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Add peft install for quickstart

Browse Source
This commit is contained in:
NanoCode012
2023-06-08 22:50:20 +09:00
parent 2b222de5b6
commit cfff94b123
1 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@@ -33,6 +33,7 @@
git clone https://github.com/OpenAccess-AI-Collective/axolotl git clone https://github.com/OpenAccess-AI-Collective/axolotl
pip3 install -e . pip3 install -e .
pip3 install -U git+https://github.com/huggingface/peft.git
accelerate config accelerate config
@@ -70,8 +71,8 @@ accelerate launch scripts/finetune.py examples/lora-openllama-3b/config.yml \
3. Install python dependencies with ONE of the following: 3. Install python dependencies with ONE of the following:
- Recommended, supports QLoRA, NO gptq/int4 support - Recommended, supports QLoRA, NO gptq/int4 support
```bash ```bash
pip3 install -U git+https://github.com/huggingface/peft.git
pip3 install -e . pip3 install -e .
pip3 install -U git+https://github.com/huggingface/peft.git
``` ```
- gptq/int4 support, NO QLoRA - gptq/int4 support, NO QLoRA
```bash ```bash