mhenrichsen dc71d8872a feat/llama-2 examples (#319) ...

* qlora llama-2

* qlora llama-2

* linting

* readme

* lora added

* linting

* change group_by_length

* 13b fitting on 24gb

* grouped lengths true

* add pad token

* change out dir

---------

Co-authored-by: Mads Henrichsen <mads@Brbar-tilhrende-Mads.local>

2023-08-03 19:22:48 +09:00

..

cerebras

more pruning

2023-06-11 10:38:24 -04:00

falcon

config fixes

2023-06-12 01:52:58 -04:00

gptj

update openllama and clean up paths

2023-06-11 11:03:31 -04:00

gptq-lora-7b

Fix config path after config moved

2023-06-12 17:06:15 +09:00

jeopardy-bot

more config pruning and migrating

2023-06-11 10:09:05 -04:00

llama-2

feat/llama-2 examples (#319)

2023-08-03 19:22:48 +09:00

mpt-7b

swap batch size for gradient accumulation steps to decouple from num gpu

2023-05-31 09:38:12 -04:00

openllama-3b

tweak config to work

2023-06-12 10:07:18 -04:00

pythia

get rid of some configs, formalize pythioa lora config

2023-06-11 09:41:41 -04:00

pythia-12b

address PR feedback

2023-06-10 14:23:56 -04:00

redpajama

Use AutoTokenizer for redpajama example

2023-06-14 20:09:26 +02:00

replit-3b

support for replit lm

2023-05-17 08:49:03 -04:00

xgen-7b

Add XGen info to README and example config

2023-07-21 00:44:50 -07:00