tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

feat: update readme instructions to include CCE installation

Browse Source
This commit is contained in:
NanoCode012
2025-08-05 17:18:20 +07:00
parent 737315b614
commit c575be59b2
4 changed files with 27 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
examples/devstral/README.md
View File

@@ -23,7 +23,13 @@ pip3 install packaging==23.2 setuptools==75.8.0 wheel ninja
pip3 install --no-build-isolation -e '.[flash-attn]' pip3 install --no-build-isolation -e '.[flash-attn]'
``` ```
2. Run the finetuning example: 2. Install [Cut Cross Entropy](https://docs.axolotl.ai/docs/custom_integrations.html#cut-cross-entropy) to reduce training VRAM usage
```bash
python scripts/cutcrossentropy_install.py | sh
```
3. Run the finetuning example:
```bash ```bash
axolotl train examples/devstral/devstral-small-qlora.yml axolotl train examples/devstral/devstral-small-qlora.yml

12
examples/hunyuan/README.md
View File

@@ -13,9 +13,11 @@ Tencent released a family of opensource models called HunYuan with varying param
git clone https://github.com/axolotl-ai-cloud/axolotl.git git clone https://github.com/axolotl-ai-cloud/axolotl.git
cd axolotl cd axolotl
pip3 install packaging==23.2 setuptools==75.8.0 wheel ninja pip3 install packaging==23.2 setuptools==75.8.0 wheel ninja
pip3 install --no-build-isolation -e '.[flash-attn]' pip3 install --no-build-isolation -e '.[flash-attn]'
# Install CCE https://docs.axolotl.ai/docs/custom_integrations.html#cut-cross-entropy
python scripts/cutcrossentropy_install.py | sh
``` ```
2. Please install HunYuan's [transformers PR](https://github.com/huggingface/transformers/pull/39606) 2. Please install HunYuan's [transformers PR](https://github.com/huggingface/transformers/pull/39606)
@@ -25,7 +27,13 @@ pip3 uninstall transformers
pip3 install git+https://github.com/huggingface/transformers@06b8c1323b366ecb5b8f8d7768f3a8b73e82f4cb pip3 install git+https://github.com/huggingface/transformers@06b8c1323b366ecb5b8f8d7768f3a8b73e82f4cb
``` ```
3. Run the finetuning example: 3. Install [Cut Cross Entropy](https://docs.axolotl.ai/docs/custom_integrations.html#cut-cross-entropy) to reduce training VRAM usage
```bash
python scripts/cutcrossentropy_install.py | sh
```
4. Run the finetuning example:
```bash ```bash
axolotl train examples/hunyuan/hunyuan-v1-dense-qlora.yaml axolotl train examples/hunyuan/hunyuan-v1-dense-qlora.yaml

8
examples/magistral/README.md
View File

@@ -21,7 +21,13 @@ pip3 install packaging==23.2 setuptools==75.8.0 wheel ninja
pip3 install --no-build-isolation -e '.[flash-attn]' pip3 install --no-build-isolation -e '.[flash-attn]'
``` ```
2. Run the finetuning example: 2. Install [Cut Cross Entropy](https://docs.axolotl.ai/docs/custom_integrations.html#cut-cross-entropy) to reduce training VRAM usage
```bash
python scripts/cutcrossentropy_install.py | sh
```
3. Run the finetuning example:
```bash ```bash
axolotl train examples/magistral/magistral-small-qlora.yaml axolotl train examples/magistral/magistral-small-qlora.yaml

3
examples/voxtral/README.md
View File

@@ -25,6 +25,9 @@ pip3 install --no-build-isolation -e '.[flash-attn]'
# audio # audio
pip3 install librosa==0.11.0 pip3 install librosa==0.11.0
pip3 install 'mistral_common[audio]==1.8.3' pip3 install 'mistral_common[audio]==1.8.3'
# Install CCE https://docs.axolotl.ai/docs/custom_integrations.html#cut-cross-entropy
python scripts/cutcrossentropy_install.py | sh
``` ```
3. Run the finetuning example: 3. Run the finetuning example: