NanoCode012 8c6a6ea6eb Feat: add devstral model support (#2880) [skip ci] ...

* fix: do not add training and training_detail block by default

* fixed: magistral docs

* fix: address pad adding new fields and use built-in from_openai

* feat: try enable multiprocessing

* fix: check for keys before deleting attn_mask

* feat: add mistral pad test

* feat: add tool calling test

* feat: add devstral tokenizer tests

* fix: comma format

* chore: remove unused support_preprocessing as tokenizer is pickable now

* chore: update magistral doc

* feat: add devstral readme and example

* chore: refactor error handling

2025-07-08 11:01:19 -04:00

..

cerebras

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

cloud

native support for modal cloud from CLI (#2237)

2025-01-30 11:34:02 -05:00

code-llama

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

cohere

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

colab-notebooks

feat: replace old colab notebook with newer one (#2838) [skip ci]

2025-06-27 10:35:47 -04:00

dbrx

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

deepcoder

feat: add examples for deepcoder (#2517)

2025-04-12 07:25:23 -07:00

deepcogito

Feat(examples): add deepcogito (#2516) [skip ci]

2025-04-11 09:52:23 -04:00

deepseek-v2

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

devstral

Feat: add devstral model support (#2880) [skip ci]

2025-07-08 11:01:19 -04:00

falcon

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

falcon-h1

feat: add falcon-h1 into axolotl (#2811) [skip ci]

2025-06-25 09:49:42 -04:00

gemma

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

gemma2

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

gemma3

feat: update CCE to use axolotl's fork (#2813) [skip ci]

2025-06-25 09:49:22 -04:00

glm4

feat: add glm and glm4 multipack and cce (#2546)

2025-04-23 10:27:51 -04:00

gptj

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

jamba

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

jeopardy-bot

simplify the example configs to be more minimal and less daunting (#2486) [skip ci]

2025-04-04 13:47:26 -04:00

llama-2

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

llama-3

support for QAT w RL (DPO) (#2776)

2025-06-13 10:00:35 -04:00

llama-3-vision

bump hf deps (#2735) [skip ci]

2025-06-05 07:20:33 -07:00

llama-4

fix(doc): clarify instruction to delinearize llama4 similar to cli doc (#2644) [skip ci]

2025-05-07 10:29:47 -04:00

llava

bump hf deps (#2735) [skip ci]

2025-06-05 07:20:33 -07:00

magistral

Feat: add devstral model support (#2880) [skip ci]

2025-07-08 11:01:19 -04:00

mamba

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

mistral

bump hf deps (#2735) [skip ci]

2025-06-05 07:20:33 -07:00

mpt-7b

simplify the example configs to be more minimal and less daunting (#2486) [skip ci]

2025-04-04 13:47:26 -04:00

openllama-3b

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

orpheus

Adds example for training a TTS model on top of a LLM. (#2614)

2025-05-06 10:11:06 +02:00

phi

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

pixtral

bump hf deps (#2735) [skip ci]

2025-06-05 07:20:33 -07:00

pythia

simplify the example configs to be more minimal and less daunting (#2486) [skip ci]

2025-04-04 13:47:26 -04:00

pythia-12b

simplify the example configs to be more minimal and less daunting (#2486) [skip ci]

2025-04-04 13:47:26 -04:00

qwen

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

qwen2

SP dataloader patching + removing custom sampler / dataloader logic (#2686)

2025-05-21 11:20:20 -04:00

qwen2_5-vl

feat: update CCE to use axolotl's fork (#2813) [skip ci]

2025-06-25 09:49:22 -04:00

qwen2-vl

fixed the lora_target_modules syntax (#2793)

2025-06-15 16:47:02 -04:00

qwen3

QAT (#2590)

2025-05-28 12:35:47 +01:00

redpajama

simplify the example configs to be more minimal and less daunting (#2486) [skip ci]

2025-04-04 13:47:26 -04:00

replit-3b

simplify the example configs to be more minimal and less daunting (#2486) [skip ci]

2025-04-04 13:47:26 -04:00

stablelm-2

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

starcoder2

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

tiny-llama

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

xgen-7b

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

yi-34B-chat

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00