Files

Wing Lian 4fde300e5f update outputs path so that we can mount workspace to /workspace/data (#1623 )

* update outputs path so that we can mount workspace to /workspace/data

* fix ln order

2024-05-15 12:44:13 -04:00

lora.yml

2024-05-15 12:44:13 -04:00

qlora.yml

2024-05-15 12:44:13 -04:00

qwen2-moe-lora.yaml

2024-05-15 12:44:13 -04:00

qwen2-moe-qlora.yaml

2024-05-15 12:44:13 -04:00

README.md

2024-03-29 11:04:53 -04:00

Qwen

TODO

Qwen2 MoE

✅ multipack ✅ qwen2_moe 4-bit QLoRA ✅ qwen2_moe 16-bit LoRA ❓ qwen2_moe 8-bit LoRA