document that packaging needs to be installed before flash-attn (#559)

This commit is contained in:
Wing Lian
2023-09-12 12:18:30 -04:00
committed by GitHub
parent 772cd870d4
commit 9845c5e12d

View File

@@ -71,6 +71,7 @@ Get started with Axolotl in just a few steps! This quickstart guide will walk yo
git clone https://github.com/OpenAccess-AI-Collective/axolotl
cd axolotl
pip3 install packaging
pip3 install -e .[flash-attn]
pip3 install -U git+https://github.com/huggingface/peft.git
@@ -105,6 +106,7 @@ accelerate launch scripts/finetune.py examples/openllama-3b/lora.yml \
3. Install axolotl along with python dependencies
```bash
pip3 install packaging
pip3 install -e .[flash-attn]
```
@@ -140,7 +142,8 @@ accelerate launch scripts/finetune.py examples/openllama-3b/lora.yml \
git clone https://github.com/OpenAccess-AI-Collective/axolotl
cd axolotl
pip3 install -e .
pip3 install packaging
pip3 install -e .[flash-attn]
pip3 install protobuf==3.20.3
pip3 install -U --ignore-installed requests Pillow psutil scipy
```