axolotl

alst

feat(doc): add optimizations table of content to our improvements (#3175 ) [skip ci]

2025-09-24 16:13:49 -04:00

apertus

feat: add apertus model and cce (#3144 ) [skip ci]

2025-09-19 17:34:04 +07:00

arcee

feat: add apertus model and cce (#3144 ) [skip ci]

2025-09-19 17:34:04 +07:00

archived

fix: unify default for conversations_field [skip-e2e] (#3070 )

2025-09-23 21:22:15 +07:00

cloud

deploy training jobs to baseten w truss in axolotl cli (#3086 ) [skip ci]

2025-08-26 09:29:50 -04:00

cohere

make pad_to_sequence_len default to the same value as sample_packing (#2941 ) [skip ci]

2025-07-21 11:40:56 -04:00

colab-notebooks

feat: add internvl3_5 (#3141 ) [skip-ci]

2025-12-25 18:07:59 +07:00

deepcogito

fix: unify default for conversations_field [skip-e2e] (#3070 )

2025-09-23 21:22:15 +07:00

deepseek-v2

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

devstral

feat : scaled softmax support (#3338 )

2026-01-13 14:33:11 +07:00

distributed-parallel

feat: update nd parallelism readme (#3039 )

2025-08-08 12:45:36 +01:00

falcon-h1

make pad_to_sequence_len default to the same value as sample_packing (#2941 ) [skip ci]

2025-07-21 11:40:56 -04:00

gemma2

make pad_to_sequence_len default to the same value as sample_packing (#2941 ) [skip ci]

2025-07-21 11:40:56 -04:00

gemma3

WIP DFT

2026-01-15 18:43:31 +00:00

gemma3n

Feat: add Magistral Small 2509 and native mistral3 tokenizer support (#3165 )

2025-09-18 15:42:20 +07:00

glm4

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

gpt-oss

feat: add trackio as experiment tracking integration (#3253 )

2025-12-23 08:49:07 -05:00

granite4

feat: add granite4 examples (#3256 ) [skip ci]

2025-11-13 10:19:16 -05:00

hunyuan

Feat: add hunyuan v1 (#3016 )

2025-09-10 09:03:30 +07:00

internvl3_5

feat: add internvl3_5 (#3141 ) [skip-ci]

2025-12-25 18:07:59 +07:00

jamba

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

kimi-linear

Feat: add kimi linear support (#3257 )

2025-12-25 17:53:52 +07:00

LiquidAI

feat: add lfm2 family and latest moe model (#3208 )

2025-10-09 10:47:41 -04:00

llama-2

Add FSDP v2 swap memory support + QLoRA compatibility fixes (#3167 )

2025-09-26 10:23:59 +01:00

llama-3

fix check for fp8 capability (#3324 )

2025-12-22 13:58:25 -05:00

llama-3-vision

fix: revert changing default optimizer to muon (#2965 ) [skip ci]

2025-07-22 10:00:30 -04:00

llama-4

fix: unify default for conversations_field [skip-e2e] (#3070 )

2025-09-23 21:22:15 +07:00

llava

fix: revert changing default optimizer to muon (#2965 ) [skip ci]

2025-07-22 10:00:30 -04:00

magistral

build examples readmes with quarto (#3046 )

2025-12-25 19:17:25 +07:00

mamba

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

mimo

Feat: add MiMo and Plano (#3332 ) [skip-ci]

2025-12-25 18:09:03 +07:00

ministral

fix: improve ministral3 docs to be clearer (#3300 )

2025-12-04 21:44:44 +07:00

ministral3

feat : scaled softmax support (#3338 )

2026-01-13 14:33:11 +07:00

mistral

build examples readmes with quarto (#3046 )

2025-12-25 19:17:25 +07:00

mistral-small

build examples readmes with quarto (#3046 )

2025-12-25 19:17:25 +07:00

olmo3

feat: cleanup old flex mask patch, suppress Matmul bnb warn, and misc (#3330 ) [skip-ci]

2025-12-25 17:56:20 +07:00

orpheus

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

phi

fix: unify default for conversations_field [skip-e2e] (#3070 )

2025-09-23 21:22:15 +07:00

pixtral

Feat: add Magistral Small 2509 and native mistral3 tokenizer support (#3165 )

2025-09-18 15:42:20 +07:00

plano

Feat: add MiMo and Plano (#3332 ) [skip-ci]

2025-12-25 18:09:03 +07:00

qat_nvfp4

Add QAT NVFP4 configs for blogpost (#3280 ) [skip ci]

2025-12-17 09:35:22 -05:00

qwen2

Distributed Muon Optimizer (#3264 )

2025-12-19 10:43:47 -05:00

qwen2_5-vl

fix: unify default for conversations_field [skip-e2e] (#3070 )

2025-09-23 21:22:15 +07:00

qwen2-vl

fix: unify default for conversations_field [skip-e2e] (#3070 )

2025-09-23 21:22:15 +07:00

qwen3

fix: update qwen3 jinja tokenization off a few tokens (#3295 )

2025-12-09 14:31:03 +07:00

qwen3-next

feat(qwen3-next): Adds targeting of shared expert and attention modules (#3183 )

2025-09-25 17:06:16 +07:00

seed-oss

Feat: add Olmo3 (BC with Olmo and Olmo2) (#3275 )

2025-11-24 10:21:31 +07:00

slurm

Example for Slurm and various fixes (#3038 ) [skip ci]

2025-08-08 08:02:03 -04:00

smolvlm2

Feat: add Olmo3 (BC with Olmo and Olmo2) (#3275 )

2025-11-24 10:21:31 +07:00

streaming

Streaming SFT support (#3101 )

2025-09-02 12:08:44 -04:00

swanlab

feat: Add SwanLab integration for experiment tracking (#3334 )

2026-01-06 09:19:18 -05:00

trinity

Feat: add MiMo and Plano (#3332 ) [skip-ci]

2025-12-25 18:09:03 +07:00

voxtral

fix: voxtralprocessor broken (#3255 ) [skip ci]

2025-11-13 10:18:42 -05:00