NanoCode012 c51d6b06c3 feat: add apertus model and cce (#3144) [skip ci] ...

* feat: add apertus, glm4v, glm4v_moe cce

* fix: arcee docs

* feat: add apertus

* feat: added vram usage

* fix: add apertus note

* feat: update doc on apertus xielu

* fix: add monkeypatch for xielu activation issue

* fix: simplify env

* feat: pin commit

* feat: add packing

* chore: move patch calling

* Update examples/apertus/README.md

Co-authored-by: salman <salman.mohammadi@outlook.com>

* Update examples/apertus/README.md

Co-authored-by: salman <salman.mohammadi@outlook.com>

* Update examples/apertus/README.md

Co-authored-by: salman <salman.mohammadi@outlook.com>

---------

Co-authored-by: salman <salman.mohammadi@outlook.com>

2025-09-19 17:34:04 +07:00

..

alst

Distributed/ND-Parallel (#2977)

2025-07-31 15:25:02 -04:00

apertus

feat: add apertus model and cce (#3144) [skip ci]

2025-09-19 17:34:04 +07:00

arcee

feat: add apertus model and cce (#3144) [skip ci]

2025-09-19 17:34:04 +07:00

archived

drop old patches and code that are no longer needed (#3007) [skip ci]

2025-08-06 08:02:39 -04:00

cloud

deploy training jobs to baseten w truss in axolotl cli (#3086) [skip ci]

2025-08-26 09:29:50 -04:00

cohere

make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]

2025-07-21 11:40:56 -04:00

colab-notebooks

feat: add apertus model and cce (#3144) [skip ci]

2025-09-19 17:34:04 +07:00

deepcogito

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897) [skip ci]

2025-07-30 06:44:06 -04:00

deepseek-v2

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897) [skip ci]

2025-07-30 06:44:06 -04:00

devstral

Feat: add hunyuan v1 (#3016)

2025-09-10 09:03:30 +07:00

distributed-parallel

feat: update nd parallelism readme (#3039)

2025-08-08 12:45:36 +01:00

falcon-h1

make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]

2025-07-21 11:40:56 -04:00

gemma2

make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]

2025-07-21 11:40:56 -04:00

gemma3

Create 270m-qlora.yml (#3075) [skip ci]

2025-09-03 16:20:32 -04:00

gemma3n

Feat: add Magistral Small 2509 and native mistral3 tokenizer support (#3165)

2025-09-18 15:42:20 +07:00

glm4

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897) [skip ci]

2025-07-30 06:44:06 -04:00

gpt-oss

feat(doc): update thinking and chat_template notes (#3114) [skip ci]

2025-09-12 14:45:18 +07:00

hunyuan

Feat: add hunyuan v1 (#3016)

2025-09-10 09:03:30 +07:00

jamba

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897) [skip ci]

2025-07-30 06:44:06 -04:00

LiquidAI

Various fixes for VLMs (#3063)

2025-08-15 10:52:57 -04:00

llama-2

drop old patches and code that are no longer needed (#3007) [skip ci]

2025-08-06 08:02:39 -04:00

llama-3

qat doc updates (#3162) [skip-ci]

2025-09-17 10:38:15 +01:00

llama-3-vision

fix: revert changing default optimizer to muon (#2965) [skip ci]

2025-07-22 10:00:30 -04:00

llama-4

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897) [skip ci]

2025-07-30 06:44:06 -04:00

llava

fix: revert changing default optimizer to muon (#2965) [skip ci]

2025-07-22 10:00:30 -04:00

magistral

Feat: add Magistral Small 2509 and native mistral3 tokenizer support (#3165)

2025-09-18 15:42:20 +07:00

mamba

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897) [skip ci]

2025-07-30 06:44:06 -04:00

mistral

Feat: add Magistral Small 2509 and native mistral3 tokenizer support (#3165)

2025-09-18 15:42:20 +07:00

orpheus

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897) [skip ci]

2025-07-30 06:44:06 -04:00

phi

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897) [skip ci]

2025-07-30 06:44:06 -04:00

pixtral

Feat: add Magistral Small 2509 and native mistral3 tokenizer support (#3165)

2025-09-18 15:42:20 +07:00

qwen2

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897) [skip ci]

2025-07-30 06:44:06 -04:00

qwen2_5-vl

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00

qwen2-vl

checkpoint model on first step callback (#2906)

2025-07-15 15:00:48 -04:00

qwen3

Center rewards coefficient (#3124)

2025-09-03 16:22:37 -04:00

seed-oss

Feat: add seedoss (#3104) [skip ci]

2025-09-10 09:01:02 +07:00

slurm

Example for Slurm and various fixes (#3038) [skip ci]

2025-08-08 08:02:03 -04:00

smolvlm2

Various fixes for VLMs (#3063)

2025-08-15 10:52:57 -04:00

streaming

Streaming SFT support (#3101)

2025-09-02 12:08:44 -04:00

voxtral

Feat: add Magistral Small 2509 and native mistral3 tokenizer support (#3165)

2025-09-18 15:42:20 +07:00