Sunny Liu f62e23737b memoize dataset length for eval sample packing (#1974) ...

* wip on multimodal sample packing support

* wip on multimodal packing support

* llama-1b-yml

* setup logging for test

* yml

* yml

* yml

* fix for __len__ for eval sample packing

* reverted irrelavant changes

* reformatted, reverted log message

* reverted unnecessary changes

* added e2e multigpu testing for eval sample packing

* formatting

* fixed e2e test_eval params

* fix test_eval e2e multigpu

* fix test_eval e2e multigpu

* Update tests/e2e/multigpu/test_eval.py

Co-authored-by: Wing Lian <wing.lian@gmail.com>

* Update tests/e2e/multigpu/test_eval.py

Co-authored-by: Wing Lian <wing.lian@gmail.com>

---------

Co-authored-by: Wing Lian <wing.lian@gmail.com>

2024-10-17 15:15:29 -04:00

..

cerebras

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

code-llama

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

colab-notebooks

Fix colab example notebook (#1805) [skip ci]

2024-08-04 13:24:26 -04:00

dbrx

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

deepseek-v2

remove dynamic module loader monkeypatch as this was fixed upstream (#1914)

2024-09-13 22:19:54 -04:00

falcon

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

gemma

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

gemma2

Reward model (#1879)

2024-10-13 15:11:13 -04:00

gptj

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

jamba

rename jamba example (#1846) [skip ci]

2024-08-22 09:22:55 -04:00

jeopardy-bot

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

llama-2

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

llama-3

memoize dataset length for eval sample packing (#1974)

2024-10-17 15:15:29 -04:00

llama-3-vision

Multimodal Vision Llama - rudimentary support (#1940)

2024-10-02 21:02:48 -04:00

mamba

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

mistral

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

mpt-7b

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

openllama-3b

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

phi

Trigger the original tokenization behavior when no advanced turn settings are provided (#1915)

2024-09-14 08:22:54 -04:00

pythia

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

pythia-12b

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

qwen

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

qwen2

ensure that the bias is also in the correct dtype (#1848) [skip ci]

2024-08-22 11:45:00 -04:00

redpajama

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

replit-3b

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

stablelm-2

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

starcoder2

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

tiny-llama

examples: fix tiny-llama pretrain yml syntax (#1840)

2024-08-21 13:37:51 -04:00

xgen-7b

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

yi-34B-chat

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00