salman 54dd7abfc1 Process reward models (#2241) ...

* adding model_cfg to set num_labels

* using a num_labels field instead

* linting

* WIP stepwise prompt tokenizer

* this should work?

* trainer working?

* pushing to runpod

* fixing saving

* updating conf

* updating config, adding docs

* adding stepwise supervision docpage

* updating tests

* adding test for dataset

* fixing tests

* linting

* addressing some comments

* adding additional cfg fields support

* updating tests, fixing cfg

* fixing tests

* updating loss

* Update test_process_reward_model_smollm2.py

* updating loss values and seed

* dumb pre-commit

2025-01-29 00:08:33 -05:00

..

cerebras

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

code-llama

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

colab-notebooks

fix build w pyproject to respect insalled torch version (#2168)

2024-12-10 16:25:25 -05:00

dbrx

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

deepseek-v2

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

falcon

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

gemma

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

gemma2

Process reward models (#2241)

2025-01-29 00:08:33 -05:00

gptj

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

jamba

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

jeopardy-bot

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

llama-2

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

llama-3

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

llama-3-vision

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

mamba

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

mistral

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

mpt-7b

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

openllama-3b

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

phi

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

pythia

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

pythia-12b

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

qwen

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

qwen2

Process reward models (#2241)

2025-01-29 00:08:33 -05:00

redpajama

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

replit-3b

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

stablelm-2

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

starcoder2

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

tiny-llama

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

xgen-7b

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00

yi-34B-chat

Add hub model id config options to all example yml files (#2196) [skip ci]

2024-12-17 11:24:30 -05:00