NanoCode012 80d5b066ec Fix: adding magistral fsdp config, fixing not eval with test_datasets, handle mllama attention (#2789) [skip ci] ...

* feat: add fsdp config for magistral

* fix: add mllama self attention handling for lora kernels

* fix: no eval if val_set_size 0 despite having test_datasets

* fix: add note for cce for vlm in newer model

2025-06-14 11:53:43 -07:00

..

cerebras

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

cloud

native support for modal cloud from CLI (#2237)

2025-01-30 11:34:02 -05:00

code-llama

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

cohere

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

colab-notebooks

fix build w pyproject to respect insalled torch version (#2168)

2024-12-10 16:25:25 -05:00

dbrx

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

deepcoder

feat: add examples for deepcoder (#2517)

2025-04-12 07:25:23 -07:00

deepcogito

Feat(examples): add deepcogito (#2516) [skip ci]

2025-04-11 09:52:23 -04:00

deepseek-v2

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

falcon

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

gemma

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

gemma2

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

gemma3

bump hf deps (#2735) [skip ci]

2025-06-05 07:20:33 -07:00

glm4

feat: add glm and glm4 multipack and cce (#2546)

2025-04-23 10:27:51 -04:00

gptj

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

jamba

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

jeopardy-bot

simplify the example configs to be more minimal and less daunting (#2486) [skip ci]

2025-04-04 13:47:26 -04:00

llama-2

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

llama-3

support for QAT w RL (DPO) (#2776)

2025-06-13 10:00:35 -04:00

llama-3-vision

bump hf deps (#2735) [skip ci]

2025-06-05 07:20:33 -07:00

llama-4

fix(doc): clarify instruction to delinearize llama4 similar to cli doc (#2644) [skip ci]

2025-05-07 10:29:47 -04:00

llava

bump hf deps (#2735) [skip ci]

2025-06-05 07:20:33 -07:00

magistral

Fix: adding magistral fsdp config, fixing not eval with test_datasets, handle mllama attention (#2789) [skip ci]

2025-06-14 11:53:43 -07:00

mamba

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

mistral

bump hf deps (#2735) [skip ci]

2025-06-05 07:20:33 -07:00

mpt-7b

simplify the example configs to be more minimal and less daunting (#2486) [skip ci]

2025-04-04 13:47:26 -04:00

openllama-3b

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

orpheus

Adds example for training a TTS model on top of a LLM. (#2614)

2025-05-06 10:11:06 +02:00

phi

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

pixtral

bump hf deps (#2735) [skip ci]

2025-06-05 07:20:33 -07:00

pythia

simplify the example configs to be more minimal and less daunting (#2486) [skip ci]

2025-04-04 13:47:26 -04:00

pythia-12b

simplify the example configs to be more minimal and less daunting (#2486) [skip ci]

2025-04-04 13:47:26 -04:00

qwen

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

qwen2

SP dataloader patching + removing custom sampler / dataloader logic (#2686)

2025-05-21 11:20:20 -04:00

qwen2-vl

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

qwen3

QAT (#2590)

2025-05-28 12:35:47 +01:00

redpajama

simplify the example configs to be more minimal and less daunting (#2486) [skip ci]

2025-04-04 13:47:26 -04:00

replit-3b

simplify the example configs to be more minimal and less daunting (#2486) [skip ci]

2025-04-04 13:47:26 -04:00

stablelm-2

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

starcoder2

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

tiny-llama

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

xgen-7b

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00

yi-34B-chat

remove strict=false from example yamls [skip ci] (#2523) [skip ci]

2025-04-12 07:25:11 -07:00