Files

Sunny Liu 1c14c4a15c Add hub model id config options to all example yml files (#2196 ) [skip ci]

* added hub model_id in example yml

* add hub model id to example yml

2024-12-17 11:24:30 -05:00

lora.yml

2024-12-17 11:24:30 -05:00

qlora.yml

2024-12-17 11:24:30 -05:00

qwen2-moe-lora.yaml

2024-12-17 11:24:30 -05:00

qwen2-moe-qlora.yaml

2024-12-17 11:24:30 -05:00

README.md

2024-03-29 11:04:53 -04:00

Qwen

TODO

Qwen2 MoE

✅ multipack ✅ qwen2_moe 4-bit QLoRA ✅ qwen2_moe 16-bit LoRA ❓ qwen2_moe 8-bit LoRA