tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

document that packaging needs to be installed before flash-attn (#559)

Browse Source
This commit is contained in:
Wing Lian
2023-09-12 12:18:30 -04:00
committed by GitHub
parent 772cd870d4
commit 9845c5e12d
1 changed files with 4 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
README.md
View File

@@ -71,6 +71,7 @@ Get started with Axolotl in just a few steps! This quickstart guide will walk yo
git clone https://github.com/OpenAccess-AI-Collective/axolotl git clone https://github.com/OpenAccess-AI-Collective/axolotl
cd axolotl cd axolotl
pip3 install packaging
pip3 install -e .[flash-attn] pip3 install -e .[flash-attn]
pip3 install -U git+https://github.com/huggingface/peft.git pip3 install -U git+https://github.com/huggingface/peft.git
@@ -105,6 +106,7 @@ accelerate launch scripts/finetune.py examples/openllama-3b/lora.yml \
3. Install axolotl along with python dependencies 3. Install axolotl along with python dependencies
```bash ```bash
pip3 install packaging
pip3 install -e .[flash-attn] pip3 install -e .[flash-attn]
``` ```
@@ -140,7 +142,8 @@ accelerate launch scripts/finetune.py examples/openllama-3b/lora.yml \
git clone https://github.com/OpenAccess-AI-Collective/axolotl git clone https://github.com/OpenAccess-AI-Collective/axolotl
cd axolotl cd axolotl
pip3 install -e . pip3 install packaging
pip3 install -e .[flash-attn]
pip3 install protobuf==3.20.3 pip3 install protobuf==3.20.3
pip3 install -U --ignore-installed requests Pillow psutil scipy pip3 install -U --ignore-installed requests Pillow psutil scipy
``` ```