tocmo0nlord/axolotl

Files

History

Wing Lian ba47adc24b replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

..

lora.yml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

qlora.yml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

qwen2-moe-lora.yaml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

qwen2-moe-qlora.yaml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

README.md

qwen2_moe support w multipack (#1455 )

2024-03-29 11:04:53 -04:00

README.md

Qwen

TODO

Qwen2 MoE

✅ multipack ✅ qwen2_moe 4-bit QLoRA ✅ qwen2_moe 16-bit LoRA ❓ qwen2_moe 8-bit LoRA