axolotl

alst

Distributed/ND-Parallel (#2977 )

2025-07-31 15:25:02 -04:00

arcee

Feat: add arcee (#3028 )

2025-08-08 08:09:11 -04:00

archived

drop old patches and code that are no longer needed (#3007 ) [skip ci]

2025-08-06 08:02:39 -04:00

cloud

make pad_to_sequence_len default to the same value as sample_packing (#2941 ) [skip ci]

2025-07-21 11:40:56 -04:00

cohere

make pad_to_sequence_len default to the same value as sample_packing (#2941 ) [skip ci]

2025-07-21 11:40:56 -04:00

colab-notebooks

feat(doc): add links to new features on README (#2980 ) [skip ci]

2025-08-08 08:16:43 -04:00

deepcogito

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

deepseek-v2

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

devstral

feat(doc): standardize the axolotl install to a release (#3040 ) [skip ci]

2025-08-08 08:00:26 -04:00

distributed-parallel

feat: update nd parallelism readme (#3039 )

2025-08-08 12:45:36 +01:00

falcon-h1

make pad_to_sequence_len default to the same value as sample_packing (#2941 ) [skip ci]

2025-07-21 11:40:56 -04:00

gemma2

make pad_to_sequence_len default to the same value as sample_packing (#2941 ) [skip ci]

2025-07-21 11:40:56 -04:00

gemma3

make pad_to_sequence_len default to the same value as sample_packing (#2941 ) [skip ci]

2025-07-21 11:40:56 -04:00

gemma3n

feat(doc): standardize the axolotl install to a release (#3040 ) [skip ci]

2025-08-08 08:00:26 -04:00

glm4

fix: remove lora in fft config

2025-08-12 20:34:47 +07:00

gpt-oss

add 120b and deepspeed zero3 examples (#3035 ) [skip ci]

2025-08-08 08:04:56 -04:00

jamba

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

lfm2

make pad_to_sequence_len default to the same value as sample_packing (#2941 ) [skip ci]

2025-07-21 11:40:56 -04:00

llama-2

drop old patches and code that are no longer needed (#3007 ) [skip ci]

2025-08-06 08:02:39 -04:00

llama-3

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

llama-3-vision

fix: revert changing default optimizer to muon (#2965 ) [skip ci]

2025-07-22 10:00:30 -04:00

llama-4

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

llava

fix: revert changing default optimizer to muon (#2965 ) [skip ci]

2025-07-22 10:00:30 -04:00

magistral

Feat: add arcee (#3028 )

2025-08-08 08:09:11 -04:00

mamba

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

mistral

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

orpheus

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

phi

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

pixtral

fix: revert changing default optimizer to muon (#2965 ) [skip ci]

2025-07-22 10:00:30 -04:00

qwen2

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

qwen2_5-vl

checkpoint model on first step callback (#2906 )

2025-07-15 15:00:48 -04:00

qwen2-vl

checkpoint model on first step callback (#2906 )

2025-07-15 15:00:48 -04:00

qwen3

use warmup_ratio as a better default than warmup steps since it's data dependent (#2897 ) [skip ci]

2025-07-30 06:44:06 -04:00

slurm

Example for Slurm and various fixes (#3038 ) [skip ci]

2025-08-08 08:02:03 -04:00

voxtral

feat(doc): standardize the axolotl install to a release (#3040 ) [skip ci]

2025-08-08 08:00:26 -04:00