tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 4 Packages Projects Releases Wiki Activity

feat: update cce for afmoe

Browse Source
This commit is contained in:
NanoCode012
2026-02-04 18:00:23 +07:00
parent 236dad3bb7
commit 57377814e9
6 changed files with 12 additions and 10 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
examples/trinity/trinity-nano-preview-qlora.yaml
View File

@@ -5,9 +5,8 @@ revision_of_model: 2ee94b0
# Automatically upload checkpoint and final model to HF
# hub_model_id: username/custom_model_name
# CCE - N/A as of now
# plugins:
# - axolotl.integrations.cut_cross_entropy.CutCrossEntropyPlugin
plugins:
- axolotl.integrations.cut_cross_entropy.CutCrossEntropyPlugin
load_in_8bit: false
load_in_4bit: true