tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

feat: add lfm2 family and latest moe model (#3208)

Browse Source 
* feat: add lfm2 family and latest moe model

* fix: use ml-cross-entropy for lfm2 examples
This commit is contained in:
NanoCode012
2025-10-09 21:47:41 +07:00
committed by GitHub
parent 6f8ce024d1
commit ab63b92c38
10 changed files with 87 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
examples/LiquidAI/lfm2-350m-fft.yaml
View File

@@ -1,6 +1,7 @@
base_model: LiquidAI/LFM2-350M
chunked_cross_entropy: true
plugins:
- axolotl.integrations.cut_cross_entropy.CutCrossEntropyPlugin
eot_tokens:
- "<|im_end|>"