Wing Lian 7a7c56f018 fixes to support fsdp-qdora

2024-04-23 08:37:04 -04:00

..

cerebras

Update qlora.yml - remove max_packed_sequence_len (#1210) [skip ci]

2024-01-26 07:43:05 -05:00

code-llama

fix(examples): remove is_*_derived as it's parsed automatically (#1297)

2024-02-22 00:52:46 +09:00

colab-notebooks

Add instructions for playing with qlora model to colab example (#1290)

2024-02-22 02:46:27 +09:00

dbrx

fixes to support fsdp-qdora

2024-04-23 08:37:04 -04:00

falcon

fix(examples): remove is_*_derived as it's parsed automatically (#1297)

2024-02-22 00:52:46 +09:00

gemma

turn sample_packing on for training (#1438) [skip ci]

2024-03-26 15:19:04 -04:00

gptj

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

jamba

fix some of the edge cases for Jamba (#1452)

2024-03-29 02:38:02 -04:00

jeopardy-bot

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

llama-2

DBRX Model Support (#1462)

2024-04-12 09:02:36 -04:00

llama-3

fix(yml): update llama-3 config (#1543) [skip ci]

2024-04-19 20:44:46 +09:00

mamba

Add seq2seq eval benchmark callback (#1274)

2024-02-13 08:24:30 -08:00

mistral

fix broken linting (#1541)

2024-04-19 01:03:04 -04:00

mpt-7b

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

openllama-3b

Add shifted sparse attention (#973) [skip-ci]

2024-01-18 10:16:07 -05:00

phi

Mixtral fixes 20240124 (#1192) [skip ci]

2024-01-24 14:59:57 -05:00

pythia

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

pythia-12b

Feat(wandb): Refactor to be more flexible (#767)

2023-12-04 22:17:25 +09:00

qwen

Fix the wrong adapter in qwen2-moe-qlora example (#1501) [skip ci]

2024-04-09 10:57:24 -04:00

redpajama

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

replit-3b

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

stablelm-2

Add StableLM 2 Example Scripts (#1327) [skip ci]

2024-02-26 18:44:25 -05:00

starcoder2

add starcoder2 (#1349)

2024-03-05 19:49:17 -05:00

tiny-llama

Update tinyllama lora.yml to fix eval packing issue (#1362)

2024-03-05 14:36:29 -05:00

xgen-7b

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

yi-34B-chat

fix(examples): remove is_*_derived as it's parsed automatically (#1297)

2024-02-22 00:52:46 +09:00