axolotl

cerebras

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

cloud

native support for modal cloud from CLI (#2237 )

2025-01-30 11:34:02 -05:00

code-llama

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

cohere

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

colab-notebooks

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

dbrx

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

deepcoder

feat: add examples for deepcoder (#2517 )

2025-04-12 07:25:23 -07:00

deepcogito

Feat(examples): add deepcogito (#2516 ) [skip ci]

2025-04-11 09:52:23 -04:00

deepseek-v2

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

falcon

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

gemma

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

gemma2

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

gemma3

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

glm4

feat: add glm and glm4 multipack and cce (#2546 )

2025-04-23 10:27:51 -04:00

gptj

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

jamba

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

jeopardy-bot

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

llama-2

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

llama-3

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

llama-3-vision

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

llama-4

make cce default to true when using the plugin (#2562 ) [skip ci]

2025-04-25 17:14:26 -04:00

llava

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

mamba

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

mistral

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

mpt-7b

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

openllama-3b

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

orpheus

Adds example for training a TTS model on top of a LLM. (#2614 )

2025-05-06 10:11:06 +02:00

phi

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

pixtral

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

pythia

simplify the example configs to be more minimal and less daunting (#2486 ) [skip ci]

2025-04-04 13:47:26 -04:00

pythia-12b

simplify the example configs to be more minimal and less daunting (#2486 ) [skip ci]

2025-04-04 13:47:26 -04:00

qwen

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

qwen2

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

qwen2-vl

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

qwen3

chat template and example for qwen3 (#2577 )

2025-04-28 15:09:41 -04:00

redpajama

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

replit-3b

fix: set replit mpt model to use eager attention

2025-05-07 17:10:18 +07:00

stablelm-2

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

starcoder2

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

tiny-llama

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

xgen-7b

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

yi-34B-chat

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00