Oliver Molenschot a4b1cc6df0 Add example YAML file for training Mistral using DPO (#2029) [skip ci] ...

* Add example YAML file for training Mistral using DPO

* chore: lint

* Apply suggestions from code review

Co-authored-by: NanoCode012 <kevinvong@rocketmail.com>

* Update mistral-dpo.yml 

Adding qlora and removing role-related data (unecessary)

* Rename mistral-dpo.yml to mistral-dpo-qlora.yml

* Apply suggestions from code review

Co-authored-by: NanoCode012 <kevinvong@rocketmail.com>

---------

Co-authored-by: Wing Lian <wing.lian@gmail.com>
Co-authored-by: NanoCode012 <kevinvong@rocketmail.com>

2024-11-13 10:06:25 -05:00

..

cerebras

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

code-llama

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

colab-notebooks

Fix colab example notebook (#1805) [skip ci]

2024-08-04 13:24:26 -04:00

dbrx

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

deepseek-v2

upgrade liger to 0.4.0 (#1973)

2024-11-07 12:53:34 -05:00

falcon

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

gemma

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

gemma2

feat: update yml chat_template to specify dataset field (#2001) [skip ci]

2024-10-29 10:26:03 -04:00

gptj

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

jamba

feat: update yml chat_template to specify dataset field (#2001) [skip ci]

2024-10-29 10:26:03 -04:00

jeopardy-bot

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

llama-2

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

llama-3

upgrade liger to 0.4.0 (#1973)

2024-11-07 12:53:34 -05:00

llama-3-vision

Multimodal Vision Llama - rudimentary support (#1940)

2024-10-02 21:02:48 -04:00

mamba

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

mistral

Add example YAML file for training Mistral using DPO (#2029) [skip ci]

2024-11-13 10:06:25 -05:00

mpt-7b

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

openllama-3b

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

phi

feat: update yml chat_template to specify dataset field (#2001) [skip ci]

2024-10-29 10:26:03 -04:00

pythia

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

pythia-12b

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

qwen

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

qwen2

ensure that the bias is also in the correct dtype (#1848) [skip ci]

2024-08-22 11:45:00 -04:00

redpajama

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

replit-3b

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

stablelm-2

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

starcoder2

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

tiny-llama

examples: fix tiny-llama pretrain yml syntax (#1840)

2024-08-21 13:37:51 -04:00

xgen-7b

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00

yi-34B-chat

update outputs path so that we can mount workspace to /workspace/data (#1623)

2024-05-15 12:44:13 -04:00