Tilemachos Chatzipapas cc250391a0 Fine-Tuning Mistral-7b for Real-World Chatbot Applications Using Axolotl (Lora used) (#1155) ...

* Mistral-7b finetune example using axolotl with code,config,data

* Corrected the path for huggingface dataset

* Update data.jsonl

* chore: lint

---------

Co-authored-by: twenty8th <twenty8th@users.noreply.github.com>
Co-authored-by: Wing Lian <wing.lian@gmail.com>

2024-01-23 07:32:21 -05:00

..

cerebras

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

code-llama

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

falcon

Falcon embeddings (#1149) [skip docker]

2024-01-22 21:01:42 -05:00

gptj

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

jeopardy-bot

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

llama-2

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

mamba

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

mistral

Fine-Tuning Mistral-7b for Real-World Chatbot Applications Using Axolotl (Lora used) (#1155)

2024-01-23 07:32:21 -05:00

mpt-7b

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

openllama-3b

Add shifted sparse attention (#973) [skip-ci]

2024-01-18 10:16:07 -05:00

phi

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

pythia

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

pythia-12b

Feat(wandb): Refactor to be more flexible (#767)

2023-12-04 22:17:25 +09:00

qwen

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

redpajama

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

replit-3b

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

tiny-llama

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

xgen-7b

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00

yi-34B-chat

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]

2024-01-22 18:44:01 -05:00