tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

fix: add dequant bf16 repo (#3507) [skip ci]

Browse Source
This commit is contained in:
NanoCode012
2026-03-20 17:11:46 +07:00
committed by GitHub
parent 7ddfb2d8a0
commit 5a5cf30b26
5 changed files with 4 additions and 7 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
examples/mistral4/README.md
View File

@@ -6,9 +6,6 @@ Thanks to the team at MistralAI for giving us early access to prepare for this r
## Getting started
Note: Training this model requires weights in BF16 which we will link to later.
Users interested in training can convert / descale the existing FP8 weights.
1. Install Axolotl following the [installation guide](https://docs.axolotl.ai/docs/installation.html).
2. Install [Cut Cross Entropy](https://docs.axolotl.ai/docs/custom_integrations.html#cut-cross-entropy) to reduce training VRAM usage