tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

feat: add lfm2 family and latest moe model (#3208)

Browse Source 
* feat: add lfm2 family and latest moe model

* fix: use ml-cross-entropy for lfm2 examples
This commit is contained in:
NanoCode012
2025-10-09 21:47:41 +07:00
committed by GitHub
parent 6f8ce024d1
commit ab63b92c38
10 changed files with 87 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
src/axolotl/integrations/cut_cross_entropy/README.md
View File

@@ -19,7 +19,7 @@ python scripts/cutcrossentropy_install.py | sh
- If you are installing from pip
```bash
pip3 uninstall -y cut-cross-entropy && pip3 install "cut-cross-entropy[transformers] @ git+https://github.com/axolotl-ai-cloud/ml-cross-entropy.git@147ea28"
pip3 uninstall -y cut-cross-entropy && pip3 install "cut-cross-entropy[transformers] @ git+https://github.com/axolotl-ai-cloud/ml-cross-entropy.git@49f3308"
```
## Usage
@@ -54,9 +54,13 @@ plugins:
- granitemoehybrid
- hunyuan_v1_dense
- hunyuan_v1_moe
- lfm2
- lfm2_moe
- lfm2_vl
- llama
- llama4
- llama4_text
- llava
- mistral
- mistral3
- mixtral