feat: update readme instructions to include CCE installation

This commit is contained in:
NanoCode012
2025-08-05 17:18:20 +07:00
parent 737315b614
commit c575be59b2
4 changed files with 27 additions and 4 deletions

View File

@@ -23,7 +23,13 @@ pip3 install packaging==23.2 setuptools==75.8.0 wheel ninja
pip3 install --no-build-isolation -e '.[flash-attn]'
```
2. Run the finetuning example:
2. Install [Cut Cross Entropy](https://docs.axolotl.ai/docs/custom_integrations.html#cut-cross-entropy) to reduce training VRAM usage
```bash
python scripts/cutcrossentropy_install.py | sh
```
3. Run the finetuning example:
```bash
axolotl train examples/devstral/devstral-small-qlora.yml