axolotl

alst

feat(doc): add optimizations table of content to our improvements (#3175 ) [skip ci]

2025-09-24 16:13:49 -04:00

apertus

separate out flash-attn install (sadly)

2025-09-30 14:58:56 -04:00

arcee

separate out flash-attn install (sadly)

2025-09-30 14:58:56 -04:00

archived

fix: unify default for conversations_field [skip-e2e] (#3070 )

2025-09-23 21:22:15 +07:00

cloud

deploy training jobs to baseten w truss in axolotl cli (#3086 ) [skip ci]

2025-08-26 09:29:50 -04:00

cohere

make pad_to_sequence_len default to the same value as sample_packing (#2941 ) [skip ci]

2025-07-21 11:40:56 -04:00

colab-notebooks

separate out flash-attn install (sadly)

2025-09-30 14:58:56 -04:00

deepcogito

fix: unify default for conversations_field [skip-e2e] (#3070 )

2025-09-23 21:22:15 +07:00

deepseek-v2

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

devstral

separate out flash-attn install (sadly)

2025-09-30 14:58:56 -04:00

distributed-parallel

feat: update nd parallelism readme (#3039 )

2025-08-08 12:45:36 +01:00

falcon-h1

make pad_to_sequence_len default to the same value as sample_packing (#2941 ) [skip ci]

2025-07-21 11:40:56 -04:00

gemma2

make pad_to_sequence_len default to the same value as sample_packing (#2941 ) [skip ci]

2025-07-21 11:40:56 -04:00

gemma3

chore: rename gemma3 270m config (#3174 )

2025-09-24 13:48:38 +07:00

gemma3n

separate out flash-attn install (sadly)

2025-09-30 14:58:56 -04:00

glm4

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

gpt-oss

separate out flash-attn install (sadly)

2025-09-30 14:58:56 -04:00

hunyuan

separate out flash-attn install (sadly)

2025-09-30 14:58:56 -04:00

jamba

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

LiquidAI

separate out flash-attn install (sadly)

2025-09-30 14:58:56 -04:00

llama-2

Add FSDP v2 swap memory support + QLoRA compatibility fixes (#3167 )

2025-09-26 10:23:59 +01:00

llama-3

fix: unify default for conversations_field [skip-e2e] (#3070 )

2025-09-23 21:22:15 +07:00

llama-3-vision

fix: revert changing default optimizer to muon (#2965 ) [skip ci]

2025-07-22 10:00:30 -04:00

llama-4

fix: unify default for conversations_field [skip-e2e] (#3070 )

2025-09-23 21:22:15 +07:00

llava

fix: revert changing default optimizer to muon (#2965 ) [skip ci]

2025-07-22 10:00:30 -04:00

magistral

separate out flash-attn install (sadly)

2025-09-30 14:58:56 -04:00

mamba

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

mistral

Feat: add Magistral Small 2509 and native mistral3 tokenizer support (#3165 )

2025-09-18 15:42:20 +07:00

orpheus

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

phi

fix: unify default for conversations_field [skip-e2e] (#3070 )

2025-09-23 21:22:15 +07:00

pixtral

Feat: add Magistral Small 2509 and native mistral3 tokenizer support (#3165 )

2025-09-18 15:42:20 +07:00

qwen2

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

qwen2_5-vl

fix: unify default for conversations_field [skip-e2e] (#3070 )

2025-09-23 21:22:15 +07:00

qwen2-vl

fix: unify default for conversations_field [skip-e2e] (#3070 )

2025-09-23 21:22:15 +07:00

qwen3

Center rewards coefficient (#3124 )

2025-09-03 16:22:37 -04:00

qwen3-next

separate out flash-attn install (sadly)

2025-09-30 14:58:56 -04:00

seed-oss

separate out flash-attn install (sadly)

2025-09-30 14:58:56 -04:00

slurm

Example for Slurm and various fixes (#3038 ) [skip ci]

2025-08-08 08:02:03 -04:00

smolvlm2

separate out flash-attn install (sadly)

2025-09-30 14:58:56 -04:00

streaming

Streaming SFT support (#3101 )

2025-09-02 12:08:44 -04:00

voxtral

separate out flash-attn install (sadly)

2025-09-30 14:58:56 -04:00