Wing Lian 328d598114 gemma3 packing fixes (#2449) ...

* make gemma3 work with packing

* multi-gpu e2e for ci

* update gemma3 model namespace to use mirror

* add gradient checkpointing to multigpu e2e ci

* update gemma3 examples for use_reentrant and fix ddp find unused params

* fix tests for gemma3

* fix import for test utils

* set correct train loss for gemma3 e2e

2025-03-31 17:15:23 -04:00

..

cerebras

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

cloud

native support for modal cloud from CLI (#2237)

2025-01-30 11:34:02 -05:00

code-llama

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

cohere

feat: add CCE for gemma3, cohere, and cohere2 (#2443)

2025-03-26 18:13:51 -04:00

colab-notebooks

fix build w pyproject to respect insalled torch version (#2168)

2024-12-10 16:25:25 -05:00

dbrx

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

deepseek-v2

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

falcon

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

gemma

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

gemma2

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

gemma3

gemma3 packing fixes (#2449)

2025-03-31 17:15:23 -04:00

gptj

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

jamba

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

jeopardy-bot

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

llama-2

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

llama-3

Sequential sample packing (#2404) [skip ci]

2025-03-31 15:48:20 -04:00

llama-3-vision

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

llava

Feat: Rework multimodal support (mllama, llava, pixtral, qwen2, qwen25, gemma3, mistral3) (#2435)

2025-03-23 11:08:51 -04:00

mamba

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

mistral

Feat: Rework multimodal support (mllama, llava, pixtral, qwen2, qwen25, gemma3, mistral3) (#2435)

2025-03-23 11:08:51 -04:00

mpt-7b

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

openllama-3b

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

phi

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

pixtral

Feat: Rework multimodal support (mllama, llava, pixtral, qwen2, qwen25, gemma3, mistral3) (#2435)

2025-03-23 11:08:51 -04:00

pythia

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

pythia-12b

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

qwen

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

qwen2

feat: add config for optional parameters in a chat message (#2260)

2025-02-18 09:59:27 +07:00

qwen2-vl

Feat: Rework multimodal support (mllama, llava, pixtral, qwen2, qwen25, gemma3, mistral3) (#2435)

2025-03-23 11:08:51 -04:00

redpajama

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

replit-3b

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

stablelm-2

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

starcoder2

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

tiny-llama

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

xgen-7b

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

yi-34B-chat

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00